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(54) Image processing system and ordering system 



(57) The image processing system identifies a sub- 
ject person corresponding to accompanying information 
based on consistency between the accompanying infor- 
mation and subject information and carries out image 
composition associating the accompanying information 
with a position of the subject person in a corresponding 
photographed image. The ordering system includes a 
first information apparatus having an image displaying 
unit and a second information apparatus capable of 
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transmitting order data at optional timing desired by a 
customer to the first information apparatus with respect 
to an image displayed on the image displaying unit. The 
first information apparatus adds predetermined data re- 
lating to the displayed image conresponding to the op- 
tional timing to the order data to prepare goods order 
data and transmits the goods order data to a third infor- 
mation apparatus in a predetermined destination of 
transmission. 
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Description 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 5 

[0001] The present invention relates to an image 
processing system and an ordering system and, in par- 
ticular, to an image processing system for compositing 
additional information concerning a subject with respect 
to a photographed image to output a composite image 
and an ordering system with which a customer places 
an order for goods while watching a television program, 
using a personal computer, playing a game, or watching 
a movie or the like, or again, from a reserved scene, or 
places an order for a print of a displayed scene or for a 
recording medium on which image data on the scene is 
recorded. (In the present invention, a recording medium 
for recording image data is to be simply referred to as 
"recording medium" or "image recording medium") . 

2. Description of the Related Art 

[0002] Conventionally, an image photographed on a 
photograph film such as a negative film and a reversal 
film (hereinafter referred to as film) has been printed on 
a photosensitive material (printing paper) by so-called 
direct exposure (analog exposure) for projecting an im- 
age on a film onto a photosensitive material and sub- 
jecting the material to planar exposure. 
[0003] On the other hand, in recent years, digital pho- 
toprinter has been put to practical use as a printing de- 
vice utilizing digital exposure, that is, an image process- 
ing system. This image processing system is for photo- 
electrically reading an image of a photographed frame 
that is photographed by a conventional camera and re- 
corded on a photograph film to obtain digital image data 
on the read image, or obtaining digital image data on a 
photographed frame photographed by a digital camera, 
then applying various kinds of image processing to the 
digital image data to have image data for recording, sub- 
jecting a photosensitive material to scan exposure with 
the recording light, which is modulated according to the 
image data for recording, so as to record an image (la- 
tent image) on the material, and preparing a (finished) 
photograph print. 

[0004] With the digital photoprinter, an image is turned 
into digital image data and exposing conditions for print- 
ing can be determined by image data processing. Thus, 
correction of washed-out highlights and dull shadows of 
an image due to backlight, strobe photographing or the 
like, sharpness processing, correction of color failure 
and density failure, correction of under exposure and 
over exposure, correction of marginal luminosity deteri- 
oration, or the like can be preferably performed to obtain 
a high-grade photograph print that has been unable to 
be obtained with the conventional direct exposure. 
Moreover, composition of a plurality of images and divi- 



sion of an image as well as composition of characters, 
or the like can be performed by the image data process- 
ing. Thus, it is possible to output a photograph print that 
is edited/processed at will according to use, for exam- 
ple, compositing additional infonmatlon or the like relat- 
ing to a photographing date and time, a photographing 
situation and a subject. 

[0005] In addition, since the digital photoprinter not 
only can output an image as a photograph print but also 
can supply image data to a computer or the like or save 
image data in an image recording medium such as a 
floppy disk, the image data can be utilized for a variety 
of uses other than a photograph. 
[0006] However, conventionally, the above-men- 
tioned composition of additional information with a pho- 
tographed image has to rely on manual editing by an 
operator and there is no service for automatically com- 
positing information concerning a subject with a photo- 
graphed image. Thus, it causes troubles to composite 
additional information concerning a subject, a message 
or the like with a photographed image. Particularly when 
a plurality of subject persons are in one image, if mes- 
sages or the like are added to respective subject per- 
sons, it is hard to understand which message is to be 
added to whom, which makes composition work very 
complicated. 

[0007] On the other hand, conventionally, when one 
scene of a television program that is being broadcast or 
one scene on the screen of a television which is repro- 
ducing images recorded on a videotape is to be printed, 
a video printer for home use is used. However, since 
such a video printer for home use has a low resolution 
and image data transmitted by a television broadcast 
suffers from a deteriorated image quality due to an effect 
of noises during transmission and various kinds of 
processing in the video printer, a high-quality print can- 
not be expected. Moreover, print sizes are fixed with a 
largest size on the order of a postcard. 
[0008] In order to address this problem, the applicant 
of this application has already proposed in JP 
10-171027 A a method and a system for printing an im- 
age that makes it possible to print a scene of a television 
broadcast or the like with a large size and high quality. 
[0009] This utilizes frame identification information for 
identifying each Image frame associating it with each im- 
age frame of a television broadcast. If a customer wish- 
es to print an image while the customer is watching each 
scene on a television screen, the customer reads out 
frame identification information of the image frame by a 
personal computer and transfers this frame identifica- 
tion information and orderer identification information, 
which Is registered in advance, to a print order receiver 
through data communicating means such as a personal 
computer to place an order for printing. The print order 
receiver specifies a frame to be printed based on the 
transmitted frame identification information and reads 
corresponding original image data of high resolution out 
of an Image database to print the image. 
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[0010] In addition, there is so-calfed television shop- 
ping as an ordering method of general goods. With the 
television shopping, a customer sees goods information 
transmitted by a television broadcast and, if there is 
goods that the customer wishes to buy, places an order, s 
for example, by telephone. 

[0011] With the method and the system disclosed in 
the above-mentioned Japanese patent application, 
since a customer can order printing by transmitting only 
frame Identification Information and orderer identifica- 
tion information by a personal computer, printing can be 
ordered simply. In addition, since an image is printed 
using original image data, a targe and high-quality print 
can be obtained. However, since all images are not al- 
ways saved In a database, an Image cannot be printed 
even if an order for the image Is placed in some cases. 
In addition, the above-mentioned conventional televi- 
sion shopping requires time and labor because a cus- 
tomer has to place an order separately using means 
such as a telephone after watching the television. 

SUMMARY OF THE INVENTION 

[0012] The present invention has been devised In 
view of the above and other drawbacks, and It is a first 
object of the present invention to provide an image 
processing system that automatically composites infor- 
mation concerning subject persons with a photographed 
Image even if a plurality of subject persons exist, thereby 
allowing a customer to easily obtain an image in which 
additional information of the photographed image (the 
subject) is composited with the photographed image 
and to conveniently obtain information of a subject per- 
son or arrange photographs In order. 
[001 3] It is a second object of the present Invention to 
provide an ordering system for allowing a customer, 
while watching television or the like, to easily order print- 
ing of an image of a scene on a television screen or the 
like at an optional or desired timing, or again, at a preset 
timing and to order goods relating to the image or gen- 
eral goods. 

[0014] In order to attain the first object described 
above, the first aspect of the present invention provides 
an Image processing system, including: an image input- 
ting unit for inputting an Image of a subject; an image 
processing unit for applying image processing to the im- 
age inputted by the image inputting unit; and an image 
outputting unit for outputting the image to which the im- 
age processing is applied by the image processing unit; 
further comprising: an accompanying Information ob- 
taining unit for obtaining accompanying information con- 
cerning a subject person of the image; a subject infor- 
mation obtaining unit for obtaining subject information 
concerning the subject person from the inputted mage; 
a person Identifying unit for identifying the subject per- 
son corresponding to the accompanying information 
based on consistency between the accompanying infor- 
mation and the subject information; and an Image com- 



positing unit for carrying out image composition associ- 
ating the accompanying information with a position of 
the subject person in a corresponding photographed im- 
age based on a result of Identification by the person 
identifying unit. 

[0015] Preferably, a camera for photographing the 
subject obtains information recorded in a predetermined 
recording medium by communicating with a portable in- 
formation apparatus held by the subject person or with 
an apparatus for collectively managing accompanying 
information for each subject person at the time of pho- 
tographing, thereby obtaining the accompanying infor- 
mation, or the accompanying information is directly ob- 
tained from the apparatus for collectively managing ac- 
companying Information. 

[0016] Preferably, all of the image processing unit, the 
image outputting unit, the accompanying information 
obtaining unit, the subject information obtaining unit, the 
person identifying unit and the image compositing unit 
are mounted with a camera, the Image processing sys- 
tem is composed of the camera, and accompanying in- 
formation concerning the subject person in a photo- 
graphed image is composited with the photographed im- 
age in the camera. 

[0017] Preferably, the camera communicates with a 
portable information apparatus held by a subject person 
or with an apparatus for collectively managing accom- 
panying information for each subject person at the time 
of photographing, thereby obtaining accompanying in- 
formation conceming the subject person. 
[0018] Preferably, the camera further includes a voice 
obtaining unit, obtains voices of the subject person with 
the voice obtaining unit at the time of photographing and 
uses the voices in carrying out the person identification. 
[0019] Preferably, the accompanying information In- 
cludes a face image of a subject person corresponding 
to the accompanying information and the person iden- 
tifying unit carries out identification of the subject person 
using the face image. 

[0020] Preferably, the Image outputting unit outputs 
an image in which the accompanying information is 
composited by at least one of a method of outputting the 
image as a print, a method of recording the image in an 
image file, a method of displaying the image on an im- 
age displaying device and a method of transferring the 
image by communication. 

[0021] In order to attain the second object described 
above, the first mode of the second aspect of the present 
invention provides an ordering system comprising: a 
first Information apparatus having an image displaying 
unit; and a second information apparatus capable of 
transmitting order data at optional timing desired by a 
customer to the first information apparatus with respect 
to an image displayed on the image displaying unit of 
the first infomiation apparatus, wherein the first informa- 
tion apparatus having received the order data adds pre- 
determined data relating to the displayed Image corre- 
sponding to the optional timing to the order data to pre- 
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pare goods order data and transmits the goods order 
data to a third information apparatus in a predetermined 

destination of transmission. 

[0022] Preferably, the order data is orderer identifica- 
tion information or order indication information for spe- s 
cifically indicating the orderer identification information 
and contents of an order, information on the optional tim- 
ing to be obtained by the first information apparatus is 
time information in the second information apparatus 
accompanying the order data or receiving timing itself 
of the order data In the first infomnation apparatus, and 
the predetermined data is image data of the displayed 
image corresponding to the optional timing or goods 
characteristic information relating the displayed image. 
[0023] Preferably, the order data includes print order 
data for ordering a print of an image displayed on the 
image displaying unit of the first information apparatus 
at the optional timing, the predetermined data includes 
image data of an image displayed on the image display- 
ing unit of the first Information apparatus at the optional 
timing, compressed image data or processed image da- 
ta thereof and information related thereto, the goods or- 
der data includes print order data for ordering a print of 
an image displayed on the image displaying unit of the 
first information apparatus, and the first information ap- 
paratus transmits the print order data to the predeter- 
mined destination of transmission and the predeter- 
mined destination of transmission applies print process- 
ing to the print order data or records and accumulates 
the print order data in a predetermined image data ac- 
cumulating device. 

[0024] Preferably, the order data includes recording 
medium order data for ordering a recording medium in 
which data corresponding to an image displayed on the 
Image displaying unit of the first infomnation apparatus 
at the optional timing is recorded, the predetermined da- 
ta includes data corresponding to the displayed image 
at the optional timing and information related thereto, 
the goods order data includes recording medium order 
data for ordering a recording medium in which data cor- 
responding to the displayed image Is recorded, and the 
first information apparatus transmits the recording me- 
dium order data to the predetermined destination of 
transmission and the predetermined destination of 
transmission applies processing for recording the re- 
cording medium order data in the recording medium or 
records and accumulates the recording medium order 
data in a predetermined image data accumulating de- 
vice. 

[0025] In order to attain the second object described 
above, the second mode of the second aspect of the 
present invention provides an ordering system compris- 
ing: a first information apparatus having an image dis- 
playing unit; and a second information apparatus capa- 
ble of transmitting order data at optional timing desired 
by a customer to the first information apparatus with re- 
spect to an image displayed on the image displaying unit 
of the first information apparatus, wherein the second 



information apparatus transmits data requiring Infonna- 
tion to the first information apparatus as the order data 
at the optional timing, the first information apparatus 
having received the data requiring information returns 
predetermined data relating to the displayed image at 
the optional timing to the second Information apparatus 
and/or a fourth information apparatus in a destination of 
communication designated by the customer, and the 
second information apparatus and/or the fourth informa- 
tion apparatus reproduces and edits the predetenmined 
data relating to the received displayed Image to prepare 
goods order data and transmits the goods order data to 
a third information apparatus in a predetermined desti- 
nation of transmission via the first information apparatus 
or directly. 

[0026] Preferably, the predetenmined data relating to 
the displayed image is at least one of image data of the 
displayed image and information related thereto. 
[0027] Preferably, the related information is goods re- 
lated information or information for inputting an order, 
and the goods order data is edited data of the informa- 
tion for inputting an order and orderer identification in- 
formation. 

[0028] Preferably, the data requiring information in- 
cludes information on the fourth information apparatus 
in the destination of communication designated by the 
customer. 

[0029] Preferably, the data requiring information in- 
cludes order data for designating the desired optional 
timing and information on the fourth information appa- 
ratus in at least one destination of communication des- 
ignated by the customer and the first infomnation appa- 
ratus distributes the predetermined data relating to the 
displayed image to the fourth information apparatus in 
the at least one destination of communication via a com- 
munication network. 

[0030] Preferably, the order data is an image data re- 
quiring signal for requiring transfer of an image dis- 
played on the image displaying means of the first infor- 
mation apparatus to the second information apparatus, 
the first infomriation apparatus having received the im- 
age data requiring signal returns Image data of the dis- 
played image at the optional timing and compressed im- 
age data or processed image data thereof to the second 
information apparatus together with the related Informa- 
tion, and the second information apparatus transmits 
the image data, the compressed Image data or proc- 
essed image data thereof and information related there- 
to to the predetermined destination of transmission as 
print order data via the first information apparatus or di- 
rectly and the predetermined destination of transmis- 
sion applies print processing to the print order data or 
records and accumulates the print order data in a pre- 
determined image data accumulating device. 
[0031] Preferably, the order data is an image data re- 
quiring signal for requiring transfer of an image dis- 
played on the image displaying means of the first infor- 
mation apparatus to the second information apparatus, 
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the first information apparatus having received the im- 
age data requiring signal returns data corresponding to 
the displayed image at the optional timing to the second 
infonnation apparatus together with the related informa- 
tion, and the second information apparatus transmits s 
the data con^esponding to the displayed image and the 
related information to the predetermined destination of 
transmission as recording medium order data via the 
first information apparatus or directly and the predeter- 
mined destination of transmission applies processing 
for recording the recording medium order data in the re- 
cording medium or records and accumulates the record- 
ing medium order data in a predetermined Image data 
accumulating device. 

[0032] In the first and second modes of the second 
aspect of the present invention, it is preferable that the 
predetemiined destination of transmission of the goods 
order data is set in the second information apparatus or 
set in the first information apparatus or set according to 
the predetermined data. 

[0033] Preferably, the order data is transmitted from 
the second information apparatus to the first information 
apparatus by the customer at the desired optional timing 
while watching the displayed Image. 
[0034] Preferably, the order data is transmitted in ad- 
vance from the second information apparatus to the first 
information apparatus by the customer as reservation 
information relating to the displayed image of the first 
information apparatus, the first information apparatus 
regards a point in time when the displayed image re- 
served by the reservation infonmation is displayed on the 
image displaying means as the desired optional timing, 
automatically obtains predetermined data relating to the 
displayed image of the image displaying means at the 
optional timing and automatically transmits the prede- 
termined data to the second information apparatus, and 
the second information apparatus automatically obtains 
the predetermined data. 

[0035] Preferably, the print order data includes print 
instruction information or data recording instruction in- 
formation. 

[0036] Preferably, the data corresponding to the dis- 
played image includes image data of the displayed im- 
age at the optional timing and compressed image data 
or processed image data thereof. 
[0037] Preferably, the data corresponding to the dis- 
played image is at least one of moving image data, voice 
data, text data and program data relating to the dis- 
played Image at the optional timing. 
[0038] Preferably, the recording medium order data 
includes information on instruction for recording in the 
recording medium or information on instruction for re- 
cording in the predetermined image data accumulating 
device. 

[0039] Preferably, the related information includes at 
least one of still image data, moving image data, voice 
data, text data and program data and is printed in asso- 
ciation with the image data and the data corresponding 



to the displayed image and outputted to a computer 
readable recording medium in association with the im- 
age data or the data corresponding to the displayed im- 
age. 

[0040] Preferably, the related information includes 
edition infonnation and/or processing information of the 
image data or the data corresponding to the displayed 

image. 

[0041] Preferably, when the first information appara- 
tus is a television receiver and predetermined data re- 
lating to the displayed image at the optional timing in- 
cludes image data of the displayed image of the televi- 
sion receiver, image data of an image received by the 
television receiver and displayed thereon and original 
image data in a broadcasting station transmitting the im- 
age data to the television receiver are properly used as 
the image data of the displayed image of the television 
receiver. 

[0042] In order to attain the second object described 
above, the third mode of the second aspect of the 
present invention provides an ordering system compris- 
ing: a first information apparatus having an image pho- 
tographing function; and a second information appara- 
tus for transmitting subject related information in image 
photographing to the first information apparatus, where- 
in the first Infonnation apparatus transmits subject relat- 
ed information transmitted from the second information 
apparatus and photographed image data to a predeter- 
mined destination of transmission as print order data, 
and the predetemiined destination of transmission com- 
posites the subject related information with the photo- 
graphed image or prints the subject related information 
on the rear side of the photographed image to prepare 
a print or associates the subject related information with 
the photographed image to output them to a computer 
readable recording medium as image data, character 
data or voice data. 

[0043] In order to attain the second object described 
above, the fourth mode of the second aspect of the 
present invention provides an ordering system compris- 
ing: a first information apparatus having an image pho- 
tographing function, and a second information appara- 
tus for receiving photographed image data and order da- 
ta transmitted from the first information apparatus, 
wherein the second information apparatus adds subject 
related information to photographed image data and or- 
der data transmitted from the first information apparatus 
to transmit them to a predetermined destination of trans- 
mission, and the predetermined destination of transmis- 
sion composites the subject related infonnation with the 
photographed image or prints the subject related infor- 
mation on the rear side of the photographed image to 
prepare a print or associates the subject related infor- 
mation with the photographed image to output them to 
a computer readable recording medium as image data, 
character data or voice data. 
[0044] In the first, second, third and fourth modes of 
the second aspect of the present invention, it is prefer- 
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able that the goods order data of the customer is tem- 
porarily accumulated, and information for confirmation 
with order transmitting route information added to the 
goods order data is transmitted to the destination of 
communication of the customer for each order item 5 
based on orderer identification information. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0045] In the accompanying drawings: 

Fig. 1 is a block diagram schematically showing a 
digital photoprinter forming an image processing 
system in accordance with a first embodiment of a 
first aspect of the present invention; 
Fig. 2 is a block diagram schematically showing a 
configuration of an image processing device in ac- 
cordance with the first embodiment of the first as- 
pect of the present invention; 
Fig. 3 conceptually illustrates actions of the first em- 
bodiment of the first aspect of the present invention; 
Fig. 4 is a block diagram schematically showing a 
camera forming an image processing system in ac- 
cordance with a second embodiment of the first as- 
pect of the present invention; 
Fig. 5 illustrates a schematic configuration of an or- 
dering system in accordance with a first embodi- 
ment of a second aspect of the present invention; 
Fig. 6 illustrates a schematic configuration of an or- 
dering system in accordance with a second embod- 
iment of the second aspect of the present invention; 
Fig. 7 illustrates a schematic configuration of an or- 
dering system in accordance with a third embodi- 
ment of the second aspect of the present invention; 
Fig. 8 illustrates a schematic configuration of an or- 
dering system in accordance with a fourth embodi- 
ment of the second aspect of the present invention; 
Fig. 9 illustrates a schematic configuration of an or- 
dering system in accordance with a fifth embodi- 
ment of the second aspect of the present invention; 
Fig. 10 illustrates a schematic configuration of an 
ordering system in accordance with a sixth embod- 
iment of the second aspect of the present Invention; 
and 

Fig. 11 illustrates a schematic configuration of an 
ordering system in accordance with a seventh em- 
bodiment of the second aspect of the present inven- 
tion. 

Fig. 12 illustrates a schematic configuration of an 
ordering system in accordance with an eighth em- 
bodiment of the second aspect of the present inven- 
tion. 

Fig. 13 illustrates a schematic configuration of an 
ordering system in accordance with a ninth embod- 
iment of the second aspect of the present invention. 



DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0046] An image processing system and an ordering 
system in accordance with the present invention will be 
hereinafter described based on preferred embodiments 
shown in the attached drawings. 
[0047] First, the image processing system in accord- 
ance with the present invention will be described with 
reference to Figs. 1 to 4. 

[0048] Fig. 1 is a block diagram schematically show- 
ing a digital photoprinter forming an image processing 
system in accordance with a first embodiment of the 
present invention. 

[0049] A digital photoprinter 10 shown in Fig. 1 basi- 
cally includes a scanner (image inputting unit) 12 for 
photoelectrically reading an image photographed on a 
film F, an image processing device 14 for processing 
read image data to make it image data for outputting 
and, also, for performing an operation, a control and the 
like of the entire digital photoprinter 10, and a printer 
(image outputting unit) 16 for exposing a photosensitive 
material (printing paper) with a light beam, which is mod- 
ulated according to the image data outputted from the 
image processing device 14, to record thereon the im- 
age and subjecting the photosensitive material to devel- 
opment to output a (finished) print. 
[0050] In addition, an operation system 18 having a 
keyboard 18a and a mouse 18b for entering or setting 
various conditions, selecting or instructing processing, 
instructing color/density correction or the like, and a dis- 
play 20 for displaying an image read by the scanner 12, 
various operational instructions, a screen for setting/ 
registering conditions or the like are connected to the 
image processing device 14. 

[0051] The scanner 12 is a device for photoelectrically 
reading an image photographed on the film F or the like 
and includes a light source 22. a variable diaphragm 24, 
a diffusion box 28 for making reading light incident on 
the film F uniform in the surface direction of the film F, 
an imaging lens unit 32, an image sensor 34 having a 
line CCD sensor corresponding to image reading for re- 
spective colors of R (red), G (green) and B(blue), an am- 
plifier 36 and an A/D (analog/digital) converter 38. 
[0052] In addition, in the print system 10, special pur- 
pose carriers 30 attachable to the main body of the scan- 
ner 12 are prepared according to a type and a size of a 
film such as a film for the Advanced Photo system (here- 
inafter referred to simply as APS) and a negative (or re- 
versal) film of the 1 35 size, a form of a film such as strips 
and slides, and the like, whereby the print system 10 
can cope with various kinds of films and processing by 
exchanging the carriers 30. An image that is photo- 
graphed on the film F and served for preparation of a 
print (or the frame of the film containing such an image) 
is conveyed to a predetermined reading position by the 
carrier 30. 

[0053] In reading an image photographed on the film 
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F on such a scanner 12, reading light, which is emitted 
from the light source 22 and whose amount is adjusted 
by the variable diaphragm 24, is Incident on the film F, 
which is positioned In a predetermined reading position 
by the carrier 30, and passes through the film F, whereby 
projecting light bearing an image photographed on the 
film F is obtained. 

[0054] The carrier 30 includes a conveying roller pair 
for conveying the film F to a predetermined reading po- 
sition and a mask having a slit for regulating the project- 
ing light for the film F to a predetermined slit shape in 
the same direction as the direction of the line CCD sen- 
sor (main scanning direction). The film F is positioned 
in the reading position by the carrier 30 and has reading 
light incident thereon while being conveyed in the longi- 
tudinal direction of the film F coinciding with the auxiliary 
scanning direction perpendicular to the main scanning 
direction. Consequently, the film F is two-dlmensionally 
slit-scanned by the slit extending in the main scanning 
direction and an image of each frame photographed on 
the film F is read. 

[0055] A magnetic recording medium is formed on an 
APS film and a magnetic head for recording/reading in- 
formation on this magnetic recording medium is dis- 
posed in the carrier 30 corresponding to the APS film 
(cartridge). The information recorded on the magnetic 
recording medium of the film F is read by this magnetic 
head and sent to the image processing device 14 or the 
like. Or again, information transferred from the image 
processing device 14 or the like to the canrier 30 Is re- 
corded on the magnetic recording medium of the film F 
by the magnetic head. 

[0056] In addition, a code reader for reading a bar 
code such as a DX code, an extended DX code and an 
FNS code to be optically recorded on the film F or vari- 
ous kinds of infonnation optically recorded on the film F 
is disposed on the canrier 30. Various kinds of informa- 
tion read by this code reader Is sent to the image 
processing device 14. 

[0057] As described above, reading light turns into 
projecting light that bears an image after passing 
through the film F held by the carrier 30. This projecting 
light is focused on a light receiving surface of the image 
sensor 34 by the imaging lens unit 32. 
[0058] The image sensor 34 is a so-called three-line 
color CCD sensor having three line CCD sensors for 
reading an R image, a G image and a B image, respec- 
tively, and extends in the main scanning direction. Pro- 
jecting light for the film F is separated into three primary 
colors of R, G and B and photoelectrically read by the 
image sensor 34. 

[0059] An output signal of the image sensor 34 is am- 
plified by the amplifier 36, converted to a digital signal 
by the A/D converter 38 and sent to the image process- 
ing device 14. 

[0060] The scanner 1 2 reads an image photographed 
on the film F by two image readings, namely pre-scan 
for reading an image with a low resolution and fine-scan 



for obtaining image data of an output image. 
[0061] The pre-scan is carried out with reading con- 
ditions for pre-scan that are set such that the image sen- 
sor 34 can read images of alt films to be read by the 

5 scanner 12 as input images without being saturated. On 
the other hand, the fine-scan Is carried out with reading 
conditions for fine-scan that are set for each frame 
based on pre-scan data such that the image sensor 34 
is saturated at a density slightly lower than a minimum 

10 density of the Image (frame). Therefore, output signals 
obtained by the pre-scan and by the fine-scan are only 
different in terms of a resolution and an output level. 
[0062] Note that, in the present invention, the scanner 
12 is not limited to such a scanner for reading an image 

15 by the slit-scanning but may be a scanner utilizing planar 
exposure in which the whole of an image of one frame 
is read at one time. In this case, it Is sufficient to use, for 
example, an area CCD sensor to sequentially insert 
color filters for respective colors of R, G and B between 

20 a light source and the film F and read an Image by the 
area CCD sensor, thereby separating an Image photo- 
graphed on the film F Into three primary colors to se- 
quentially read for the three colors. 
[0063] As described above, the output signal (image 

25 data) from the scanner 12 is outputted to the image 
processing device 14. 

[0064] In addition, a driving device 42 is connected to 
the image processing device 14. The driving device 42 
reads out image data and accompanying information or 

30 the like of a subject person from an image data recording 
medium such as a Smartmedia for recording digital im- 
age data obtained by photographing an image by a dig- 
ital camera or the like, or outputs image data after 
processing to a general purpose image data recording 

35 medium such as an FD, a CD-R, an MO. a DVD, a Zip 
or the like. 

[0065] Moreover, a slot 44 or the like is also connected 
to the image processing device 14 of this embodiment. 
The slot 44 or the like is directly connected to various 

40 image data supply sources such as a personal computer 
and a digital camera, equipment for collectively manag- 
ing accompanying information of each subject person, 
or the like via a cable or via a communication network 
and obtains digital image data and its photographing in- 

45 formation, accompanying information of a subject or the 
like. Therefore, in the digital photoprinter 10, the image 
processing device 14 may receive image data and in- 
formation from these various image data supply sources 
other than an image on the film F read by the scanner 

50 12 and carry out the following processing. 

[0066] In the first embodiment to be described below, 
the case in which digital image data is supplied mainly 
from the scanner 12 to the image processing device 14 
and outputted from the printer 1 6 as a photographic print 

55 will be described as a representative example. 

[0067] Fig. 2 is a block diagram schematically show- 
ing a configuration of the image processing device 14 
in accordance with the first embodiment of the present 
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invention. 

[0068] The image processing device 14 applies pre- 
determined innage processing to image data that is read 
by the scanner 12 and sent to the image processing de- 
vice 1 4 as digital data and outputs the image data to the s 
printer 16 or the like. The image processing device 14 
is composed mainly of a data processing unit 46, a pre- 
scan memory 48, a fine-scan memory 50, a pre-scan 
image processing unit 52, a fine-scan image processing 
unit 54 and a condition setting unit 56. In addition, in this 
emt)odiment, the image processing device 14 includes 
a subject information obtaining unit 68 for obtaining in- 
formation concerning a subject person from an inputted 
image, a person identifying unit 70 for identifying a sub- 
ject person based on consistency between accompany- 
ing information of a subject person and information of 
the subject person, which are obtained by a camera at 
the time of photographing or obtained from equipment 
collectively managing information, and an image com- 
positing section 64 that is disposed in the fine-scan im- 
age processing unit 54 and composites an image asso- 
ciating the accompanying information with a corre- 
sponding subject person in the photographed image. 
[0069] The data processing unit 46 applies logarith- 
mic conversion, DC offset correction, dark time correc- 
tion, shading correction or the like to the digital image 
data (input image data signal) for R, G and B outputted 
from the scanner 12. Processed pre-scan (image) data 
is stored in the pre-scan memory 48 and processed fine- 
scan (image) data is stored in the fine-scan memory 50. 
[0070] Image data stored in the pre-scan memory 48 
and the fine-scan memory 50 are called to the pre-scan 
image processing unit 52 and the fine-scan image 
processing unit 54, respectively, for image processing 
as required before outputting. 
[0071] The pre-scan image processing unit 52 con- 
sists of a pre-scan processing section 58 and a data 
converting section 60. The pre-scan processing section 
58 is a section for carrying out color balance adjustment, 
contrast adjustment, contrast correction, brightness cor- 
rection, sharpness processing, dodging processing and 
other image processing. In addition, the data converting 
section 60 converts image data to which image process- 
ing is applied in the pre-scan processing section 58 to 
image data corresponding to a display by the display 20 
using 3DLUT or the like. 

[0072] The fine-scan image processing unit 54 con- 
sists of a fine-scan processing section 62, image com- 
positing section 64, data converting sections 66a, 66b 
and 66c. In the fine-scan processing section 62, various 
kinds of image processing such as color balance adjust- 
ment, contrast correction (tone processing), brightness 
correction, color saturation correction, sharpness 
processing and dodging processing are applied to fine- 
scan data in accordance with image processing condi- 
tions set in the condition setting unit 56 as described 
below. In the Image compositing section 64, information 
accompanying a subject person in a photographed im- 



age Is composited with the subject person in association 
with its position. The data converting sections 66a, 66b 
and 66c converts image data after image processing to 
a form corresponding to each image outputting means, 
namely the printer 16, the driving device 42 and the slot 
44. 

[0073] The condition setting unit 56 reads out pre- 
scan data from the pre-scan memory 48, determines 
reading conditions and image processing conditions of 
fine-scan and sets the conditions in each necessary part 
such as the pre-scan processing section 58 and the fine- 
scan processing section 62. More specifically, the con- 
dition setting unit 56 carries out preparation of a density 
histogram, calculation of characteristic amount of an im- 
age such as an average density, an LATD (largest area 
transmission density), a highlight (minimum density) 
and a shadow (maximum density) or the like from the 
pre-scan data. In addition, image processing conditions 
are determined according to an instruction made by an 
operator if necessary and Image processing conditions 
are reset by an Input from the operation system 18 such 
as the keyboard 18a and the mouse 18b. 
[0074] In addition, as described above, the image 
processing device 14 in this embodiment includes the 
subject information obtaining unit 68 and the person 
identifying unit 70 and carries out identification of a sub- 
ject person in an image in order to composite accompa- 
nying information of the subject person in a predeter- 
mined position in the image. 

[0075] The subject Information obtaining unit 68 re- 
ceives pre-scan data and obtains subject information 
such as Information for use In Identifying a person and 
positional information of a subject in an image in order 
for use in compositing an image from the pre-scan data. 
For example, a face image of a subject person is pref- 
erably illustrated as information to be used in identifying 
a subject person. In this case, the subject information 
obtaining unit 68 extracts the face image of the subject 
person in an image from the pre-scan data. 
[0076] In this case, accompanying information of the 
subject person includes face image data and the person 
identifying unit 70 carries out pattern matching of the 
extracted face Image and the face image in the accom- 
panying information to identify a person. 
[0077] It is found which subject each piece of accom- 
panying information should be composited with to from 
the person identification. Thus, in the Image composit- 
ing section 64, accompanying information including a 
message or the like of each subject person is compos- 
ited adapting it to a position of each subject person 
based on the positional information of the subject in the 
image obtained as described above. 
[0078] An image in which accompanying information 
is composited is converted in each of the data convert- 
ing sections 66a. 66b and 66c according to an output 
medium and outputted to an output medium desired by 
a customer. 

[0079] Actions of the first embodiment will be hereln- 
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after described. 

[0080] In this embodiment, in photographing a multi- 
plicity of subject persons with a camera, for example, 
the camera communicates with a hand-held terminal 
(PDA) carried by each subject person to obtain accom- 5 
panying information of the subject person in question 
and record it on a predetermined recording medium. 
Then, an order for printing is placed with a laboratory 
and there prepared a print by compositing the accom- 
panying information with an image of the relevant sub- io 
ject person, 

[0081] Fig. 3 conceptually illustrates actions of the 
first embodiment of the present invention. 
[0082] For example, in a certain party site or the like, 
if a multiplicity of subject persons 1 00 are photographed i5 
by a camera 110, each subject person 100, who is a 
participant, has its own hand-held terminal (hereinafter 
referred to as PDA) 102, in which message information 
(accompanying information) with a face image of the 
subject person is recorded in advance. 20 
[0083] This message information is not limited to, for 
example, text data but may be image data and voice 
data. 

[0084] In photographing each subject person 1 00 with 
the camera 110, a photographer communicates be- 25 
tween a communication terminal 112 provided on the 
camera 110 side and the PDA 102 of each subject per- 
son and obtains message information (accompanying 
information) of each subject person 100. The camera 
1 1 0 may be a silver salt camera or a digital camera (still 30 
image/moving image). 

[0085] The camera 110 records the obtained mes- 
sage information in a predetermined recording medium. 
Here, a recording medium and a recording method are 
not specifically limited. Message information may be 35 
magnetically recorded in a film or may be recorded in 
an IC chip, which is inserted in a film cartridge, or, in the 
case of a digital camera, may be written in a recording 
medium such as a Smartmedia together with image da- 
ta. 40 
[0086] In addition, If message information is recorded 
in a recording medium separate from a film, it is prefer- 
able to record a film ID, a frame number and the like 
together with the message information such that they 
are used for image composition later. 45 
[0087] In addition, it is also possible to ask partici- 
pants of a party in advance, for example, to wear a spe- 
cial name plate having a function of linking with a PDA 
of each participant to emit light when exchanging infor- 
mation with a camera and to photograph the name plate so 
with the camera. In this way, at the time of photograph- 
ing, when the camera and each subject person commu- 
nicate with each other, the name plate of a subject per- 
son being currently photographed emits light at the com- 
munication timing. Therefore, it becomes easy to figure ss 
out a position of each person in a photographed image 
later. 

[0088] In addition, rather than each participant of a 



party owning a PDA. for example, it is also possible that 
a host of the party manages message information of 
each participant collectively by a host computer 1 20 and 
the host computer 120 on the host side and the camera 
110 communicate with each other and the camera 110 
obtains message information of each participant. 
[0089] Further, the communication between the cam- 
era 110 and the host computer 120 may be performed 
at each photographing time or may be collectively per- 
formed at a predetermined timing after photographing. 
In this way, since each subject person 100 is neither re- 
quired to own the PDA 102 nor to perform communica- 
tion between the camera 110 and the PDA 102 of each 
subject person 100, complexity for a photographer to 
photograph while paying attention to communication be- 
tween each participant and the PDA 102 can be elimi- 
nated. Alternatively, rather than obtaining message in- 
formation by the camera 110, a laboratory 130 may ob- 
tain message information directly from the host compu- 
ter 1 20 at the time of image processing in the laboratory 
130 later. 

[0090] In addition, if the camera 110 has a voice data 
obtaining function, the camera 1 1 0 may obtain voice da- 
ta generated by a subject person as message informa- 
tion. In this case, a gender, an age or the like may be 
determined according to this voice data and used for 
identifying a person. 

[0091] Alternatively, in a case of photographing a 
moving image by a digital camera, a person may be 
identified by deriving a position in an image from a timing 
for each subject person speaking and a timing for a 
mouth moving, estimating a gender, an age or the like 
from voices of the subject person and combining clien- 
tele determining processing with the estimation. In ad- 
dition, if voices are included as message infonmation, a 
speaker may be recognized according to registered 
voices and voices at a photographing time to identify a 
person. 

[0092] When photographing is performed and mes- 
sage information of each subject person is obtained to- 
gether with image data by a camera as described above, 
these are carried to the laboratory 130 and printing is 
ordered, image processing is carried out by the digital 
photoprinter 10 as shown in fig. 1 and a print is prepared 
in the laboratory 130. 

[0093] Upon receiving an order, an operator inserts 
the film F In a predetenmined carrier 30 and sets it in a 
predetermined reading position of the scanner 12. Pro- 
Scan image data pre-scanned and read in the scanner 
12 is applied, as digital input image data, each process- 
ing such as logarithmic conversion, DC offset correc- 
tion, dark time correction and shading correction in the 
data processing unit 46 as described above and then 
stored in the pre-scan memory 48. in addition, the con- 
dition setting unit 56 calls pre-scan data from the pre- 
scan memory 48, calculates a characteristic amount of 
an Image or the like and determines image processing 
conditions. In addition, after adjusted by an instruction 



50 



55 



9 



17 



EP1 199 876 A2 



18 



of the operator, the pre-scan data Is applied correction 
such as color balance adjustment, color density con-ec- 
tion or brightness correction and contrast correction or 
color saturation correction according to the determined 
image processing conditions in the pre-scan processing 5 
section 58 of the pre-scan image processing unit 52. 
Further, after sharpness processing or dodging 
processing is performed according to an instruction of 
the operator, the pre-scan data is converted using 
3DLUT or the like in the data converting section 60 and io 
displayed on the display 20. 

[0094] Further, in the case of a digital image photo- 
graphed by a digital camera or the like, it is possible to 
obtain image data via a disk drive from an image data 
recording medium such as a floppy disk (FD), an MO, a is 
Zip, a CD-R and a DVD or obtain Image data from a 
communication network. In this case, the Image data is 
stored In the pre-scan memory 48 and the fine-scan 
memory 50 and the subsequent image processing is 
performed in the same manner as that for image data 20 
read by the scanner 12. 

[0095] In addition, when processing for pre-scan data 
is carried out, for example. In the scanner 12, message 
information is simultaneously read from a magnetic re- 
cording medium of a film or an IC chip or the like inserted 25 
in a film cartridge and message information Including 
face Image data of a subject person Is sent to the person 
identifying unit 70. On the other hand, the subject Infor- 
mation obtaining unit 68 receives the pre-scan data via 
the condition setting unit 56 (or directly from the pre- 30 
scan memory 48) and extracts subject information nec- 
essary for identification of a person or composition of an 
image later. 

[0096] The subject information obtaining unit 68 ex- 
tracts a face image of a subject person in an image. 35 
[0097] As a method of extracting a face area of a per- 
son, particularly hair, there is, for example, a method 
disclosed in JP 8-122944 A of the applicant of this ap- 
plication. In addition, as a method of extracting a specific 
area such as a face area of a person, methods disclosed 
in JP 4-346333 A, JP 5-158164 A, JP 5-165120 A. JP 
6-160993 A, JP 8-184925 A, JP 9-101579 A, JP 
9-138470 A. JP 9-138471 A, JP 9-146194 A. JP 
9-197575 A and the like can also be preferably utilized. 
[0098] The person identifying unit 70 carries out pat- ^5 
tern matching of the face image of the subject person 
extracted by the subject information obtaining unit 68 
and a face image Included In message Information to 
identify the subject person and confirm which message 
information is composited with which image. At this 50 
point, information such as a gender and an age is used 
if such information exists In the message information, 
or, even If such information does not exist, a gender, an 
age, an occupation or the like is estimated by the follow- 
ing clientele determination method and such estimated ss 
Information is utilized to carry out person identification, 
whereby the person identification can be carried out 
more accurately. 



[0099] As the clientele determination method for esti- 
mating a gender, an age. an occupation or the like, for 
example, a method of estimating a gender, a person can 
be estimated as female if, as a result of extracting a face 
image (hair), a volume of a hair area is large, if the hair 
area is long, if an outline of the torso and the lower part 
seem to be a skirt judging from a shape of clothes ex- 
tracted from the pattern matching of the outline, or if 
color contains many shades of red and pink. In addition, 
from a result of extracting a face image, it is also possi- 
ble to estimate a gender based on whether a person 
wears makeup or not. uses a lipstick or not or wears 
accessories or not. 

[0100] In addition, as a method of estimating an age. 
a method of calculating a height of a subject person from 
a photographed image to estimate that a person is an 
adult, a junior high or a high school student, an elemen- 
tary school student, an Infant or the like based on a size 
of a height is possible. Alternatively, if a volume of an 
extracted hair area is small or if a color of hair is white, 
a person is estimated to be an aged person. 
[0101] In addition, an occupation Is estimated mainly 
according to clothes. For example, if clothes are likely 
to fall into a category of suits judging from a shape, a 
density and a tint of clothes, a subject person can be 
estimated as belonging to a white-collar worker layer. If 
clothes is likely to fall into a category of uniforms judging 
from a shape and a color of the clothes, a subject person 
can be estimated as a student including a junior high 
and a high school students taking a result of estimation 
of a gender and an age into account. 
[0102] Further, a clientele determining method is not 
limited to these but various other methods can be used. 
[0103] On the other hand, fine-scan is performed in 
accordance with conditions determined by the condition 
setting unit 56 and predetermined image processing Is 
applied to read fine-scan data in the fine-scan process- 
ing section 62. 

[0104] Thereafter, in the image compositing section 
64, message information corresponding to each subject 
person is composited which is adapted to a position of 
a subject person in the image extracted by the subject 
information obtaining unit 68 using the above result of 
person identification. 

[0105] In this case, when communication is per- 
formed between a camera and a PDA of each subject 
person at the time of Image photographing. It Is also pos- 
sible to give different message information for each con- 
secutive photographing frame. In doing so, it is sufficient 
that identification information such as a film ID and a 
frame number Indicating which message information 
corresponds to which frame is included in message in- 
formation. In this case, the image compositing section 
64 can composite an image using the identification in- 
formation such as a frame number. Thus, person iden- 
tification becomes unnecessary but it is necessary to 
perform extraction of a face image or the like for com- 
positing an image to extract a position of a subject per- 
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son in an image. 

[0106] Image data to which image compositing 
processing was applied may be converted to data for a 
print output by the data converting section 66a and out- 
putted as a print from the printer 1 6 as desired by a cus- s 
tomer, or may be converted to data for an image file out- 
put by the data converting section 66b and outputted to 
a predetermined recording medium from the driving de- 
vice 42, Alternatively, the image data may be converted 
to a predetermined form by the data converting section io 
66c and laid open through a communication network 
from the slot 44 or transmitted to a predetermined ter- 
minal apparatus. 

[0107] In this case* a composited image itself may be 
returned to the customer (or each subject person) or on- 
ly access destination information for obtaining image 
data may be returned. 

[0108] A second embodiment of the present invention 
will be described next. 

[0109] In this embodiment, a camera itself fomns an 
image processing system and person identification 
processing and image compositing processing are car- 
ried out by the camera. 

[0110] Fig. 4 schematically shows a configuration of 
a camera forming an image processing system in ac- 
cordance with this embodiment. 
[0111] As shown in Fig. 4, a camera 210 of this em- 
bodiment is a digital camera and includes an image in- 
putting unit 21 2 for photographing a subject person 200, 
an image memory 214 for storing photographed image 
data and image processing unit 21 6 for carrying out pre- 
determined image processing, and further includes a 
communication terminal 218 for communicating with a 
PDA 202 owned by the subject person 200 to obtain 
message information, a subject information obtaining 
unit 220 for obtaining information of a subject person 
from inputted image data, a person identification unit 
222 for identifying a person from the information of the 
subject person and the message information, an image 
compositing unit 226 for compositing message informa- 
tion to the inputted image, an image outputting unit 228, 
and a voice obtaining unit 224 for inputting voice infor- 
mation of a subject person in order to use in person iden- 
tification and the like. In this way, the camera 210 forms 
one image processing system for performing from im- 
age input to image processing and image output. 
[0112] The image inputting unit 212 is for performing 
ordinary image photographing by an image pick-up el- 
ement such as a CCD via a lens. An image photo- 
graphed and inputted is stored in the image memory 214 
as digital image data. The image data stored in the im- 
age memory 214 is called to the image processing unit 
216, where image processing such as white balance ad- 
justment and Y correction is applied to the image data. 
[0113] On the other hand, the subject information ob- 
taining unit 220 calls image data from the image memory 
214 and extracts a face image or the like of a subject 
person. The person identification unit 222 receives the 



face image of the subject person from the subject infor- 
mation obtaining unit 220 and identifies the subject per- 
son by applying pattern matching to the face image of 
the subject person and a face image of a subject person 
in the message information received from the commu- 
nication tenminal 218. In addition, in this case, accuracy 
of the person identification may be improved utilizing 
voice data inputted from the voice obtaining unit 224. 
[0114] When the person identification is performed, 
based upon the result, the message information is com- 
posited in an appropriate position with respect to a sub- 
ject person in an image after the image processing in 
the image compositing unit 226. The image data after 
composition is outputted from the image outputting unit 
228. The outputted image is displayed on an image dis- 
playing device such as a liquid crystal panel and, at the 
same time, recorded in a predetermined image record- 
ing medium. 

[0115] Note that, although the communication termi- 
nal 218 communicates with the PDA 202 owned by each 
subject person 200 at the time of photographing to ob- 
tain message information, a method of obtaining mes- 
sage information is not limited to this. For example, the 
communication terminal 218 may communicate with an 
apparatus such as a host computer 230 or the like that 
collectively manages message infonnation to obtain 
message information from the apparatus. Alternatively, 
the camera 210 may be connected to a personal com- 
puter (not shown) to obtain message information from 
the host computer 230 via a communication line. 
[0116] In addition, as to a form of outputting an image, 
an image may be outputted as a print, for example, as 
long as the camera 210 has a print outputting function. 
[0117] As described above, since information con- 
cerning a subject person can be composited automati- 
cally according to each of the above-mentioned embod- 
iments, it is convenient for obtaining information of a 
subject person and arranging information in order. In 
particular, for example, it is very convenient for exchang- 
ing information among participants of a party or the like. 
[01 18] In particular, according to the second embodi- 
ment, since all processing can be carried out on the 
camera side, an image in which message information is 
composited can be obtained simply and promptly and 
information of a subject person can be obtained more 
easily. 

[0119] Further, if an image is outputted as digital data, 
when a pointing device is clicked on a subject person at 
the time of reproducing an image, accompanying mes- 
sage information may be reproduced and outputted next 
to the subject person. In addition, message information 
may be composited with a photographed moving image. 
Moreover, in these cases, it is possible to use a still im- 
age, a moving image, a text, voices or the like as mes- 
sage information. 

[0120] Next, an ordering system in accordance with a 
second aspect of the present invention will be described 
with reference to Figs. 5 to 11. 
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[0121] First, a first embodiment of the second aspect 
of the present invention will be described. The first em- 
bodiment is the case in which, for example, a customer 
places an order for printing one scene of a television 
screen while watching the television. 5 
[0122] Fig. 5 schematically illustrates a configuration 
of an ordering system in accordance with the first em- 
bodiment. 

[0123] The ordering system shown in Fig. 5 is basi- 
cally composed of a television 310 that is a first infor- 
mation apparatus, a camera 312 that is a second infor- 
mation apparatus and a laboratory 314 that is a desti- 
nation to which goods order data is sent. 
[0124] The television 31 0 is a television having a net- 
work communication function, and it not only receives 
radio waves so as to reproduce images and voices to 
display reproduced images on a screen and generate 
reproduced voices but also has an information transmis- 
sion function capable of transmitting, for example, order 
information of a customer to an optional destination. 
Moreover, it is assumed that the television 310 is a dig- 
ital television and has a storage device (e.g. a hard disk 
(HD)) 316 for temporarily recording and accumulating 
received image data. The storage device 316 may be 
built into the television 310 or of external type. In this 
case, related information corresponding to an image in 
question is also recorded in the storage device 316 to- 
gether with the digital image data (hereinafter refen^ed 
to simply as "image data"). 

[0125] The camera 312 Is connected to the television 
310 by a wireless communication technology such as 
the Bluetooth, for example, and has an image obtaining 
mode separate from ordinary photographing. If a cus- 
tomer presses a shutter or a predetermined key in this 
mode while the customer is watching the television 310, 
print order information for an image displayed on the dis- 
play screen of the television 310 at that point is trans- 
mitted to the television 310 side. Further, the television 
310 may be an ordinary television for home use that is 
installed indoors or may be one installed outdoors such 
as on the street. Any television will do as long as order 
information can be transmitted from the camera 312 to 
the television 310 side by wireless communication. 
[0126] In addition, this information apparatus on the 
customer side (second information apparatus) is not lim- 
ited to such a camera but may be any apparatus as long 
as it can transmit infomiation to the television 310 by 
wireless communication, such as a PDA (hand-held ter- 
minal), a personal computer, a cellular phone and a re- 
mote control. 

[0127] Actions of this embodiment will be hereinafter 
described. 

[0128] The television 310 receives a television signal 
from a television station to display a reproduced image 
on the display screen of its own and, at the same time, 
records image data on the displayed image in the stor- 
age device 316. Besides image data, the television sig- 
nal includes, for example, related information (hereinaf- 



ter referred to also as "related data") such as description 
or the like about the image (scene) or the program. Such 
related data may be transmitted utilizing a space area 
of radio waves as. for example, in the teletext broad- 
casting. 

[0129] If there is a scene that a customer wishes to 
obtain while watching images displayed on the screen 
of the television 310, the customer uses the camera 31 2 
set to an image obtaining mode in advance and presses 
its shutter at an optional selection timing. Then, order 
data is transmitted from the camera 31 2 to the television 
310 side. 

[0130] The order data includes orderer identification 
information (customer ID) and order indication informa- 
tion. The order indication information is infomiation for 
specifically indicating contents of an order and includes, 
for example, print size, the number of prints, contents of 
desired image processing and a method of receiving a 
print. The contents of desired image processing may be 
various kinds of image processing that can be per- 
formed by an image processing device used in the first 
aspect of the present invention, for example. As image 
processing, there may specifically be designated image 
modification processing such as density/tint adjustment, 
tone adjustment, change in general impression, and 
change of ordinary finishing into sepia finishing, mono- 
chrome finishing or the like, as well as image edition 
processing such as producing of an index image for a 
plurality of frames, image compositing, position/size ad- 
justment, and superimpositlon of characters. According- 
ly, the order data may of course include information con- 
cerning such image modification or edition processing 
as above. The order data may further include message 
infonmation of a customer. 

[0131] Transmission of order data from the camera 
312 to the television 310 may be carried out at each in- 
stance when the customer presses the shutter. Alterna- 
tively, order data may be once stored in the storage de- 
vice in the camera 312 together with time data (time in- 
formation of the camera at that time) when the customer 
presses the shutter, and then order data for a plurality 
of times of pressing the shutter may be collectively 
transmitted to the television 310 side at a separate tim- 
ing. 

[0132] Upon receiving order data from the camera 
312, the television 310 transmits the received order data 
and image data (in some cases, with the addition of im- 
age related data (goods characteristic information)) as 
goods order data to the laboratory 314 via a network. A 
timing for selecting image data to be transmitted may 
be according to time information of the time when the 
customer pressed the shutter of the camera 312 or may 
be according to a timing when the television 310 re- 
ceives order data from the camera 312. 
[0133] The laboratory 314 is provided with the digital 
photoprinter 10 as shown in Figs. 1 to 4, for example. 
Upon receiving goods order data, the laboratory 314 ap- 
plies predetermined image processing to the transmit- 
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ted image data in accordance with the order data using 
the image processing device 14 shown in Figs. 1 and 2, 
for example, and prepares a print with the printer 16 
shown in Figs. 1 and 2, for example. In addition, the lab- 
oratory 314 may record and store the image data in a 5 
specified image data storing device for possible reorder 
in the future, for example. Further, as optional process- 
ing in response to the request of a customer, the labo- 
ratory 314 may print a description or an advertisement 
of a scene (or a program) using image related data, or 
print message information of the customer and the like 
on the back of a print. In addition to or apart from such 
printing, the image data may be recorded on various 
types of general purpose recording media, such as a 
FD. a CD-R, an MO, a DVD and a Zip, by the driving 
device 42 shown in Figs. 1 and 2, for example. In this 
case, a description or an advertisement of an image 
whose image data is to be recorded, message informa- 
tion of a customer or the like may be recorded coinci- 
dentally with the image data as accompanying there- 
with. 

[01 34] Next, a second embodiment of the present in- 
vention will be described. 

[0135] The second embodiment is the case in which 
a customer orders printing of one scene of a movie while 
watching a movie in a theater. 
[0136] Fig. 6 illustrates a schematic configuration of 
an ordering system in accordance with the second em- 
bodiment. 

[0137] The ordering system shown in Fig. 6 is basi- 
cally composed of a communication and control facility 
320 of a theater that is a first information apparatus, an 
information terminal apparatus (e.g., a hand-held termi- 
nal such as PDA) 330 of a customer that is a second 
infonmation apparatus and a laboratory 332 that is a des- 
tination to which goods order data is sent. 
[0138] It is assumed that a movie is projected using 
digital image data in a theater in this embodiment. The 
communication and control facility 320 includes a con- 
trol device 324 and a receiving device 326. The receiv- 
ing device 326 is installed near seats of the theater and 
connected to the control device 324 via wire or wireless 
to receive a signal (order data) from the information ter- 
minal apparatus 330 of a customer and transmit it to the 
control device 324. 

[01 39] The control device 324 projects an image on a 
screen 322 and, at the same time, receives order data 
of a customer from the receiving device 326 to transmit 
it to the laboratory 332 together with image data or the 
like through a network line or the like. In addition, a stor- 
age device 328 for recording an image and its related 
data Is connected to the control device 324. 
[0140] The information terminal apparatus 330 of a 
customer is not limited to a hand-held terminal such as 
PDA but may be, for example, a cellular phone, a remote 
control provided in a seat or the like. 
[0141] Actions of this embodiment will be hereinafter 
described. 



[0142] The control device 324 projects a movie image 
on the screen 322 on the basis of image data as digital 
data. If there is a scene that a customer wishes to obtain 
while watching the screen 322, the customer transmits 
order data from the information terminal apparatus 330 
at hand to the receiving device 326 installed near the 
seat by pressing a key at an optional or desired selection 
timing. In this case, the order data includes orderer iden- 
tification information (customer ID) and order indication 
Infomfiatton as In the first embodiment. 
[0143] The receiving device 326 transmits the re- 
ceived order data to the control device 324 at every re- 
ception of order data or at one time after it has received 
order data several times. The control device 324 calls 
image data and related data corresponding to the order 
data from the storage device 328 at every reception of 
order data or at one time after it has received order data 
several times and transmits them to the laboratory 332 
together with the order data, as goods order data as a 
whole. 

[0144] The laboratory 332 applies predetermined im- 
age processing designated by the order data to the 
transmitted image data to prepare a print or record the 
processed image data on a recording medium, as in the 
first embodiment described before. In this embodiment, 
similar to the first embodiment, related data such as a 
description of a displayed image (scene) or the program 
in question, or message information of a customer, a 
theater or the like may be back printed, or recorded on 
a recording medium coincidentally with the image data 
as accompanying therewith. 

[0145] in addition, as another example of this embod- 
iment, the ordering system may be configured as a sys- 
tem for an image of a poster instead of an image of a 
movie projected on a screen, with which system order 
data is received from an information terminal apparatus 
of a customer and then transmitted to a laboratory by a 
transceiver, which is set for example on the back of the 
poster, to print the image of the poster or output a re- 
cording medium on which the image data of the Image 
in question is recorded. 

[0146] Though the entire image displayed on a screen 
of a television or a movie is to be ordered in the first and 
second embodiments as described above, the present 
invention is not limited to such. A part of an image dis- 
played on a screen may be ordered or even several 
parts of an image displayed on a screen may selectively 
be ordered. In these cases, positioning information, the 
number of orders and the like with respect to an image 
on a screen may be designated by key operation or 
handwriting on the aforementioned information terminal 
apparatus such as a camera, a PDA, a cellular phone, 
a remote control and a personal computer to add to the 
order data. 

[0147] In various embodiments as above, the first in- 
formation apparatus is a television provided with a com- 
munication function, or a communication and control fa- 
cility in a theater, or a communication device (transceiv- 
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er) set on a poster. The present invention is not limited 
to such apparatus and any of a game machine, a per- 
sonal computer and other apparatus with a display may 
also be used as the first information apparatus as long 
as it is provided with a communication function. 5 
[0148] In respective embodiments as described 
above, and in the case that a plurality of order data are 
transmitted to the first information apparatus such as a 
television by a plurality of customers, such order data 
may be classified according to customers or images 
(goods) and goods order data may be produced accord- 
ing to customers or Images (goods) on the first Informa- 
tion apparatus side to transmit to a laboratory. Specifi- 
cally, a plurality of order data for different kinds of imag- 
es (goods) may be classified as from one and the same 
customer or a plurality of order data from different cus- 
tomers may be classified as for one and the same Image 
(goods), 

[0149] In respective embodiments as described 
above, moreover, it is possible to automatically detect 
Images, which are analogous to the displayed image of 
a television or a movie once designated with an Infor- 
mation apparatus such as a camera and a PDA on the 
customer's side at a desired selection timing, among, 
for example, the images displayed within a predeter- 
mined period after a time designated or the images 
stored in a storage device to collectively display them 
toward the customer or collectively transmit the image 
data on them to the customer. 
[0150] In addition, in the embodiments as above, re- 
lated data such as a description of a displayed image 
(scene) or the program in question and message infor- 
mation of a theater or the like to be printed on the back 
of a printer recorded on a recording medium coinciden- 
tally with the image data as accompanying therewith are 
represented as linear images such as characters, for ex- 
ample. The present invention is not limited to such and 
the Information and data as above may also be repre- 
sented as at least one selected from the group consist- 
ing of an image such as a still image and a moving im- 
age, a voice, a text and a program. 
[0151] Next, a third embodiment of the present inven- 
tion will be described. 

[0152] In the first and the second embodiments as de- 
scribed above, image data is transmitted to a laboratory 
from the side of a television, a theater and the like. On 
the other hand, in the third embodiment, image data is 
transmitted to a laboratory directly from an information 
apparatus of a customer. 

[0153] Fig. 7 illustrates a schematic configuration of 
an ordering system in accordance with the third embod- 
iment. 

[0154] As shown in Fig. 7, this system is configured 
basically the same as the system configuration of the 
first embodiment shown in Fig. 5 and is composed of a 
television 340 that is a first information apparatus, a 
camera 342 that is a second information apparatus and 
a laboratory 344 that is a destination to which goods or- 



der data is sent. 

[01 55] The television 340 Is a digital television having 
a network communication function and has a storage 
device 346 for temporarily recording and accumulating 
received image data. In addition, the camera 342 Is con- 
nected to the television 340 by wireless communication 
and has an Image obtaining mode separate from an or- 
dinary photographing. Further, as In the first embodi- 
ment, the information apparatus on the customer side 
is not limited to the camera 342 but may be any appa- 
ratus such as a PDA. a personal computer, a cellular 
phone and a remote control as long as It can transmit 
information by wireless communication. 
[0156] If there is a scene that a customer wishes to 
obtain while watching the television 340, the customer 
sets the camera 342 to the Image obtaining mode and 
presses its shutter at an optional selection timing. Then, 
an image data request signal, which requests transfer 
of an image displayed at that point, is transmitted from 
the camera 342 to the television 340. This signal may 
include an order signal Indicating a print size or the like. 
[0157] Upon receiving the Image request signal, the 
television 340 transmits the Image data to the camera 
342 wirelessly. At this point, if the image request signal 
also includes the order signal, it is preferable to control 
an amount of information to conform to the print size, for 
example, compress the image data, and return it. Fur- 
ther, since an optional image transmitted by the televi- 
sion broadcast is printed, a problem under a copyright 
may arise depending on how the print is used. Thus, an 
image quality may be intentionally decreased to an im- 
age quality lower than that of the original image to be 
printed In order to protect a copyright. It is preferable to 
automatically impose a license fee based on a copyright 
upon printing at a laboratory 344 as described below, 
especially when there Is an appreciable fear of Interfer- 
ence with a copyright. 

[0158] Upon receiving the image data, on the camera 
342 side, it is sufficient to order printing in the same man- 
ner as in the case in which an image Is photographed 
ordinarily with the camera 342. Printing may be ordered 
by transmitting the image data, its related infomiatlon 
and the like to the laboratory 344 via network commu- 
nication directly from the camera 342, or may be ordered 
by outputting the data to a recording medium and bring- 
ing the recording medium to the laboratory 344. The lab- 
oratory 344 applies predetermined Image processing to 
the Image data according to the related information and 
the order information to prepare a print or output a re- 
cording medium containing the processed data, as in 
the respective embodiments as described above. 
[01 59] In this embodiment, it is preferable that the im- 
age data, which Is transmitted from the television 340 
side to the information apparatus such as the camera 
342 and a PDA of a customer, includes two components, 
namely image data on images for displaying (having a 
lower resolution) and encoded image data on images 
for printing (having a higher resolution). Under such cen- 
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ditionSp only contract laboratories having a key which 
enables decoding of encoded image data can obtain en- 
coded Image data and cany out printing or outputting of 
recording media. Thus, images can be prevented from 
being appropriated by a third party. s 
[0160] Next, a fourth embodiment of the present in- 
vention will be described. 

[0161] The fourth embodiment is the case In which an 
image is actually photographed by a camera and a print 
with predetemiined information added thereto Is or- 
dered. 

[0162] Fig. 8 Illustrates a schematic configuration of 
a system of this embodiment. 
[0163] As shown in Fig. 8, this system basically con- 
sists of a camera 350 of a customer, who is a photogra- 
pher, as a first information apparatus, an information ter- 
minal apparatus 352 held by a subject person that is a 
second information apparatus and a laboratory 354. 
[0164] The camera 350 is a digital camera that also 
has a communication function. The information tenmlnal 
apparatus 352 held by a subject person is not specifi- 
cally limited but may be any apparatus such as a PDA 
(hand-held terminal), a cellular phone and the like as 
long as it has a function of communicating and exchang- 
ing Information with the camera 350. In addition, the 
camera 350 is capable of communicating with the Infor- 
mation terminal apparatus 352 and transmitting and re- 
ceiving data to and from the laboratory 354 via network 
communication. 

[0165] This embodiment is for exchanging informa- 
tion between the camera 350 held by a photographer 
and the Information terminal apparatus 352 held by a 
subject person 351 and preparing a print In which a pho- 
tographed image and message information transmitted 
by the subject person 351 are composited with each oth- 
er. 

[0166] The exchange of information may be arranged 
such that a data request signal is transmitted from the 
camera 350 to the information terminal apparatus 352 
of the subject person 351 when the photographer pho- 
tographs the subject person 351, and, In response, the 
subject person 351 returns message Information from 
the Information terminal apparatus 352. Alternatively, 
the exchange of information may be arranged such that 
the subject person 351 side transmits a message that 
should be Inserted In an Image to be photographed next 
from the information terminal apparatus 352 to the cam- 
era 350 and the camera 350 receives it. For message 
infonmation, various types of data such as images in- 
cluding a still image and a moving image, voices, a text 
and a program may be employed. 
[0167] The photographer transmits an image shot on 
spot, which Is obtained by photographing the subject 
person 351 with the camera 350, to the laboratory 354 
via networic communication from the camera 350 to- 
gether with the message transmitted from the informa- 
tion terminal apparatus 352 of the subject person 351 
as print order data. The laboratory 354 composites the 



image shot on the spot transmitted from the camera 350 
and the message information to prepare a print shot on 
the spot 356. 

[0168] Next, a fifth embodiment of the present inven- 
tion will be described. 

[0169] The fifth embodiment is for transmitting order 
data as well as image data to a laboratory from an in- 
formation apparatus on a subject side instead of from a 
camera, although an image is photographed with the 
camera as in the fourth embodiment. 
[0170] Fig. 9 illustrates a schematic configuration of 
an ordering system of this embodiment. 
[0171] As shown in Fig. 9, this system basically con- 
sists of a camera 360 of a customer, who is a photogra- 
pher, as a first infonmatlon apparatus, an information ter- 
minal apparatus 362 on a subject side that is a second 
information apparatus and a laboratory 364. 
[0172] The camera 360 is a digital camera having a 
communication function like the camera 350 of the 
fourth embodiment. In addition, for example, in the case 
in which a subject is a flower 361 in a flower bed In a 
park, the Information terminal apparatus 362 Is a data 
transceiver or the like embedded in the ground under 
the flower 361 . Upon receiving a signal from the camera 
350, the data transceiver transmits the signal to the lab- 
oratory 364 through a control device 363a installed in, 
for example, a park management facility. 
[01 73] When the customer being a photographer pho- 
tographs the flower 361 with the camera 360 and trans- 
mits photographed image data and order data from the 
camera 360 to the information tenminal apparatus (data 
transceiver) 362, the Information terminal apparatus 
362 transmits the Image data and the order data to the 
laboratory 364 through the control device 363a. In this 
case, it is preferable that the control device 363a stores 
related Information of the subject (here, a name of the 
flower being the subject or the like) in a storage device 
363b and adds the information to the order data to trans- 
mit it. 

[0174] Upon receiving transmission of the data, the 
laboratory 364 prepares a print 366 in which an Image 
of the flower being an Image shot on the spot is com- 
posited with its related infonmatlon, for example, a name 
or an origin of the flower. 

[0175] Although printing is ordered from a laboratory 
in each of the embodiments described above, if related 
infonnation (or message information) is composited in 
a print, the related information may be composited on 
the surface of the print or may be printed on the back of 
the print as shown in Figs. 8 and 9. 
[0176] In addition, image data may be outputted to a 
computer readable recording medium (a floppy disk, a 
CD-R or the like) together with related Information in ad- 
dition to simply outputting it as a print. In this case, it Is 
possible to record voice data in addition to image data 
such as a still image and a moving image together in 
advance to reproduce the data and execute the proce- 
dure by a computer. It is sufTicient for the customer to 
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inform that, for example, the customer wishes the image 
data to be outputted to a CD-R or the like instead of be- 
ing printed based on the order data. 
[0177] On the other hand, embodiments to be de- 
scribed below are the case in which a customer orders 5 
not only a print but also general goods while watching 
an advertisement on the screen of a television or the 
like. 

[01 78] Next, a sixth embodiment of the present inven- 
tion will be described. 

[0179] Fig. 10 illustrates a schematic configuration of 
an ordering system in this embodiment. 
[0180] As shown in Fig. 10, this system is basically 
composed of a television 370 that is a first information 
apparatus, an information terminal apparatus 372, for 
example a PDA, of a customer, that is a second infor- 
mation apparatus and a goods order center 374 to which 
goods order data is sent. 

[0181] The television 370 is a television having a net- 
work communication function and has a storage device 
376 for recording and accumulating received data, re- 
lated infonmation of advertised goods or the like as in 
the above-mentioned embodiments. 
[0182] A television signal including data relating to ad- 
vertised goods Is transmitted to the television 370. Upon 
receiving the signal, the television 370 displays an ad- 
vertisement of the goods on a screen and, at the same 
time, temporarily stores related information in the stor- 
age device 376. 

[0183] If there are goods that a customer wishes to 
buy while watching an advertisement on the screen of 
the television 370, the customer presses a key or the 
like of the information terminal apparatus 372 such as 
a PDA at hand to transmit a customer ID (customer iden- 
tification information) and order infomnation to the tele- 
vision 370. Infomiation characteristic of the goods such 
as a specification, for example, a product number, the 
number of pieces of goods, a color and a size is added 
to the order information. Upon receiving the customer 
ID and the order information, the television 370 trans- 
mits related information (goods data or the like) corre- 
sponding to the order information of the pertinent goods 
as goods order data to the goods order center 374 via 
network communication or the like. Upon receiving the 
goods order data, the goods order center 374 delivers 
the goods to a home 378 of the customer by a home 
delivery service based on the data. In this case, the 
goods order center 374 may return data for inputting an 
order or order confirmation data to a place designated 
by the customer separately for confirmation of the order. 
[01 84] Next, a seventh embodiment of the present in- 
vention will be described. 

[0185] Fig. 11 illustrates a schematic configuration of 
an ordering system of this embodiment. 
[01 86] As shown in Fig. 1 1 , the system of this embod- 
iment also has a configuration similar to that of the sys- 
tem of the sixth embodiment shown in Fig. 10 and is 
composed of a television 380, an information tenminal 



apparatus 382 of a customer and a goods order center 
384. In addition, the television 380 includes a storage 
device 386. A television signal including data related to 
advertised goods is transmitted to the television 380. 
Upon receiving the television signal, the television 380 
displays an advertisement of the goods on a screen and. 
at the same time, temporarily stores related information 
in the storage device 386. 

[0187] A customer transmits a data request signal 
from the Information terminal apparatus 382 at hand to 
the television 380 at an optional selection timing if there 
are goods that the customer wishes to buy while watch- 
ing the television 380. Upon receiving the data request 
signal, the television 380 returns goods related informa- 
tion to the information terminal apparatus 382 of the cus- 
tomer. The received goods related information is repro- 
duced and displayed on a monitor of the information ter- 
minal apparatus 382. The customer sees this display 
and edits data for inputting an order such as a specifi- 
cation, for example, a product number, the number of 
pieces, a color and a size to prepare goods order data. 
[0188] Then, the customer adds data such as a cus- 
tomer ID and a method of receiving goods and transmits 
goods order data to the television 380 from the informa- 
tion terminal apparatus 382. 

[0189] Upon receiving the goods order data, the tele- 
vision 380 transmits the goods order data to the goods 
order center 384 via network communication. The trans- 
mission of the goods order data may be performed col- 
lectively for goods or may vary for each commercial. The 
goods order center 384 dispatches ordered goods to 
each customer in accordance with the goods order data. 
[0190] The goods may be delivered to a home of the 
customer by a home delivery service, or the customer 
may receive the goods at a nearby agent shop (e.g., a 
convenience store or the like). 
[0191] In addition, goods may be separately ordered 
by a customer rather than through a television as de- 
scribed above. For example, the ordering system may 
be a system that allows a customer to order goods 
through a laboratory while ordering printing of photo- 
graphs. 

[0192] It is preferable that, if a customer obtains a 
scene in a television program from a television by his 
information terminal apparatus, the customer can see 
not only goods but also an advertisement of goods re- 
lated to the goods in question on the screen. Moreover, 
it is preferable that, if a customer presets a specific 
goods item, conditions for automatically obtaining (cap- 
turing) information and the like with respect to a televi- 
sion program by his information terminal apparatus, a 
displayed image, goods information, information related 
to the image or the goods, or the like, is automatically 
captured in the information terminal apparatus of the 
customer at the point when an advertisement of the item 
is broadcast. 

[0193] That is to say. it is preferable that a mode, in 
which images and goods information are to be automat- 
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ically obtained or captured, can be set. As an example, 
IDs each of which is specific to a given kind of goods 
may be added to broadcast data in advance so as to 
use for the setting of such an auto-capturing mode as 
above according to the kind of goods. Specifically, an 
advertisement for an automobile, for example, can be 
auto-captured conveniently every time when such an 
advertisement is displayed on a television. Or again, 
with respect to a game machine in a game arcade, a 
pachlnko parlor or the home, conditions for automatical- 
ly capturing images may previously be set and transmit- 
ted from an information apparatus such as a PDA of a 
customer to the game machine. Thus, an image can be 
auto-captured conveniently when, for example, the 
score made is high or exceeds a predetermined level, 
or a predetermined scene has been cleared. 
[0194] Further, although the case in which a customer 
watches an advertisement on the screen of a television 
to order goods is described in the above-mentioned 
sixth and seventh embodiments, a display screen is not 
limited to that of a television but it is possible to apply 
the system to the case in which the customer watches 
an advertisement (image) on a screen such as a screen 
of a personal computer, a screen of a game machine, 
or a poster (regardless of whether it is in or out of the 
home and provided that a transceiver is provided on the 
back of the poster) and orders goods. In addition, the 
infomnation terminal apparatus of the customer is not 
limited to, for example, a hand-held terminal such as a 
PDA but an apparatus having an information communi- 
cating function such as a camera, a personal computer, 
a cellular phone and a remote control can be used. 
[0195] Next, an eighth embodiment of the present in- 
vention will be described. 

[0196] In the first and third embodiments as described 
above, the image data that the first information appara- 
tus such as the television has received is sent to the 
laboratory directly or through the information terminal 
apparatus of a customer. The eighth embodiment is di- 
rected to the case in which an original image stored in 
a broadcast station and image data of the original image 
received by a television or the like are selectively used 
as required. 

[0197] Fig. 12 illustrates a schematic configuration of 
an ordering system of the eighth embodiment. 
[0198] As shown in Fig. 12, this ordering system com- 
prises a television 390 which Is a first information appa- 
ratus, a hand-held terminal (hereinafter typified by a 
PDA) 392 of a customer which is a second information 
apparatus, a laboratory 394 to which goods order data 
is sent, and a broadcast station 396 which transmits an 
image received by the television 390. 
[01 99] The television 390 is a digital television having 
a communication function, and has a storage device 
(HDD) 391 for temporarily recording and storing re- 
ceived image data. The PDA 392 is connected to the 
television 390 by wireless communication and has an 
image obtaining mode different from the ordinary pho- 



tographing mode. As in the first embodiment, the infor- 
mation apparatus on the customer side is not limited to 
the hand-held terminal such as the PDA 392 but may 
also include information terminal apparatuses such as 

5 a personal computer, a cellular phone, a camera and a 
remote controller as long as they can transmit informa- 
tion by wireless communication. 
[0200] When there is a scene that the customer wish- 
es to obtain, the customer performs a key manipulation 

10 or a designation by hand on the PDA 392 at an optional 
or desired selection timing white watching the television 
390. As a result, an image data request signal for re- 
questing transfer of a displayed image is sent from the 
PDA 392 to the television 390. This signal may include 

15 an order signal indicating a print size or the like. 

[0201] Upon receipt of the image data request signal, 
the television 390 transmits image data of the displayed 
image to the PDA 342 wirelessly. That is, the PDA 392 
receives a low-resolution image adapted for monitor dis- 

20 play. Preferably, the image data Is for example com- 
pressed or thinned out to control the amount of data (in- 
formation) in accordance with the display image size on 
a monitor of the PDA 392, or in accordance with the print 
size if the image data request signal also includes the 

25 order signal, whereupon a reduced image with a low res- 
olution can be transmitted. Identification Information (ID) 
of the displayed image is also preferably attached to the 
image data. 

[0202] The PDA 392 that received the image data dis- 
30 plays the image, for example the reduced image on the 
monitor of the PDA 392. After the customer confirms the 
image, an image ID or image data of the reduced image 
is returned to the television 390 together with order data 
and further related information of the displayed image. 
35 [0203] While watching the image displayed on the 
monitor of the PDA 392, the customer performs desired 
image processing steps from among modification 
processing such as density/color adjustment, gradation 
adjustment, modification in general impression, and fm- 
^0 ishing modification to sepia-toned finishing or mono- 
chrome finishing, as well as edition processing such as 
production of an index image for a plurality of frames, 
image composition, layout/size adjustment, and charac- 
ter insertion. The customer may perform other process- 
es ing that can be performed in the image processing de- 
vice according to the first aspect as described above, or 
image processing such as the modification processing 
and the edition processing by means of commercially 
available software programs. 
50 [0204] In this case, it is preferred that the order data 
also includes image processing information from the 
customer such as infomnation concerning the modifica- 
tion processing (hereinafter simply referred to as "mod- 
ification information") and information concerning the 
55 edition processing (hereinafter simply referred to as 
"edition information"), in other words, image processing 
information as to which frame the customer processed, 
or which Image processing the customer performed 
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among the modification processing and edition process- 
ing. 

[0205] On the television 390 side that received the im- 
age ID or the image data of the reduced image together 
with the order data and further the related Information, 5 
the image ID or the image data of the reduced image is 
used to search for the image data of the corresponding 
displayed Image in the storage device 391. The image 
data of the image obtained by the search, the order data 
received, and the related Infonmation are transmitted to 
the laboratory 394 as the goods order data for placing 
an order for printing or recording on a recording medium. 
That is, an order is placed for prints or a recording me- 
dium having data recorded therein. It should be noted 
here that the order data may include the image process- is 
ing information. 

[0206] On the laboratory 394 side, the image data is 
subjected to specified image processing steps based on 
the order data and related information received as in 
each of the embodiments as described above. The thus 20 
processed image data is used to produce prints or out- 
put a recording medium. If the order data includes the 
image processing information, the modification 
processing and edition processing can be reproduced 
on the image data according to the image processing 25 
infomiation (modification information and edition Infor- 
mation) transmitted together with the image data. 
[0207] When the print size requested in the order data 
is large, the resolution of the image data is very often 
Insufficient to obtain an image print of high quality and 30 
high resolution data is necessary. In this case, according 
to this embodiment, the television 390 side transmits the 
image ID, the order data (which may include the image 
processing information) and further the related informa- 
tion that were received from the PDA 392, to the labo- 35 
ratory 394 as the goods order data to thereby place an 
order for printing and an order for recording on a record- 
ing medium. 

[0208] On the laboratory 394 side, the received image 
ID is transmitted to the broadcast station 396, where a ^0 
database 397 is searched using the transmitted image 
ID to read out high-resolution image data of the original 
image used in broadcasting. The image ID is returned 
with the image data of the original image obtained by 
the search from the broadcast station 396 side to the 45 
laboratory 394 side. 

[0209] Thereafter, on the laboratory 394 side, the im- 
age data of the original image received from the broad- 
cast station 396 is used together with the order data and 
the related information of the corresponding image ID so 
received from the PDA 392 to perfomn specified image 
processing steps as in each of the embodiments as de- 
scribed above. For example, when the order data in- 
cludes the image processing information, the modifica- 
tion processing and edition processing are reproduced ss 
in accordance with the image processing Information to 
thereby produce a print or output a recording medium. 
[021 0] The method for transferring the original image 



used in broadcasting from the broadcast station 396 to 
the laboratory 394 is not particularly limited but any con- 
ventionally known method can be employed. For exam- 
ple, the method disclosed in commonly assigned JP 
10-171027 A can be employed. 
[0211] If a large print size is requested, the original 
image in the broadcast station 396 is used, and the im- 
age received on the television 390 is otherwise used. 
This selective use of the original image and the received 
image in accordance with the requested print size ena- 
bles outputting a print on which a high quality image is 
reproduced. The laboratory 394 side may determine as 
to which of the original image and the Image received 
on the television 390 is used. 

[0212] The requested print size is not the sole factor 
for determining which of the original image and the re- 
ceived image is used, and determination of the image 
to be used may depend on any factor. For example, a 
method may be applied in which the original image is 
selected when the original image is present In the data- 
base 397 of the broadcast station 396, and otherwise 
the image received on the television 390 Is used. 
[021 3] According to this embodiment, the Image data 
transmitted to the PDA 392 has a low resolution, but 
even when any image on the air is to be printed, a print 
having a high-resolution and high-quality image can be 
produced from the original image in the laboratory 394. 
The laboratory 394 In which automatic charging based 
on the copyright can be performed enables appropriate 
protection of the copyright. 

[0214] The Image accompanying data (various types 
of data including still image, moving Image, voice, text 
and program) which Is not included In the broadcasting 
data (transmission data) may be stored in the database 
397 of the broadcast station 396 so that the image ac- 
companying data can be also supplied in response to 
the image request from the customer for use in compo- 
sition on a print or recording on a recording medium. In 
this case, charging may be also done in accordance with 
the image accompanying data. 
[021 5] Next, a ninth embodiment of the present inven- 
tion will be described. 

[0216] In the third, seventh and eighth embodiments 
as described above, the image data of the image dis- 
played on the first information apparatus such as the tel- 
evision and designated from the customer side is re- 
turned to the second information apparatus on the cus- 
tomer side such as the camera or the hand-held terminal 
including the PDA which was used for designating the 
displayed image and which has a communication func- 
tion. In contrast, the ninth embodiment transmits the dis- 
played image not only to the Information apparatus on 
the customer side in which the displayed image was 
designated, but also to the destination (or Information 
apparatus) designated by the customer. 
[0217] Fig. 13 illustrates a schematic configuration of 
an ordering system of the ninth embodiment. 
[0218] As shown in Fig. 13, the ordering system of this 
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embodiment comprises a television 400 which is a first 
information apparatus, a hand-held terminal (hereinaf- 
ter typified by a PDA) 402 of a customer A which is a 
second information apparatus, a laboratory 404 and a 
goods order center 406 to which goods order data is s 
sent, a communication network called the Internet 408 
which is connected to the television 400, the laboratory 
404 and the goods order center 406, respectively, and 
a home personal computer 410 of the customer A and 
a cellular phone 420 of a customer B to which the Inter- 
net 408 is connected. 

[0219] The components used may be the same as 
those disclosed in each of the embodiments described 
above. Therefore, detailed description will be omitted. 
[0220] The television 400 receives broadcasting data 
(television signal) from the television station and dis- 
plays a reproduced image on the display screen while 
recording image data of the displayed image on a stor- 
age device 401. 

[0221] When there is a scene that the customer A 
wishes to obtain, the customer A preliminarily selects 
an image obtaining mode in the PDA 402 to designate 
the scene (image frame) at an optional or desired se- 
lection timing, while watching the image displayed on 
the screen of the television 400. After the scene is des- 
ignated, image request data including a transfer request 
is transmitted from the PDA 402 to the television 400 
side. The image request data includes orderer identifi- 
cation information (customer ID), scene (image-frame) 
designating information and information concerning the 
destination (contact address) to which the transfer of the 
image data is requested. In addition to these types of 
information, the image request data may also include 
order information and message information from the 
customer A. 

[0222] Inclusion of the information concerning the 
destination (contact address) to which the transfer of the 
image data is requested in the image request data to be 
transmitted from the customer's PDA 402 to the televi- 
sion 400 enables transfer to the home personal compu- 
ter 410 via the Internet 408 in case of lack of memory of 
the customer's PDA 402 or request for high quality im- 
age data. In addition, this is also effective when the cus- 
tomer A that found a desired image or goods while 
watching the television 400 away from home, wants to 
carefully consider at home or to give some information 
to his friend prior to actually placing an order. The frame 
of the scene can be designated in the PDA 402 and the 
information concerning the destination of the image data 
can be transmitted to the television 400 side. 
[0223] In this case, the timing information for the 
scene (frame) designation may be temporarily stored on 
the PDA 402 side to transmit at a different timing the 
information concerning the destination to which the 
transfer of the displayed scene image is requested. Al- 
ternatively, a set of the timing information for the frame 
designation and the information concerning the destina- 
tion in the transfer request may be transmitted when 



each frame is designated. Further, the destination may 
be set for each frame image designated or for a plurality 
of frame images in a batched manner. 
[0224] Upon receipt of the image request data from 
the PDA 402, the television 400 reads out image data 
of the designated scene (frame) image from the storage 
device 401 based on the scene (Image-frame) designat- 
ing information in the received image request data. The 
image data is transmitted through the network to the 
destination designated based on the information con- 
cerning the destination (contact address) included in the 
received image request data, after the image related 
(accompanying) data (goods characteristic informa- 
tion), the order data and further optionally the order in- 
fomnation and the message information from the cus- 
tomer A have been added thereto. 
[0225] Any infomnation apparatus may be designated 
as the destination, and examples include the home per- 
sonal computer 410, and the cellular phone 412, a PDA 
or a personal computer that his friend possesses. It is 
needless to say that the customer A may designate his 
PDA 402 or cellular phone as the destination in the em- 
bodiment under consideration. 
[0226] Further, the image data to be transferred from 
the television 400 to the designated destination may be 
the image displayed on the television 400 per se or the 
reduced image thereof. 

[0227] The image data to be transferred from the tel- 
evision 400 to the designated destination may be re- 
placed by the data on the site to which reference is made 
on the image displayed on the television 400. In this 
case, the designated destination side that received the 
data on the site for reference can obtain the image and 
its accompanying data by getting access to the site. 
[0228] If the customer A or B wants to place an order 
for an image or goods, the customer A or B places the 
order by transmitting from the designated contact appa- 
ratus, that is, the home personal computer 410 or the 
cellular phone 412. a set of the image data or goods 
data, its related infonmation and the order data (includ- 
ing the customer ID. order information and message in- 
formation from the customer A) to the laboratory 404 or 
the goods order center 406 as the goods order data. 
[0229] Upon receipt of the goods order data, the lab- 
oratory 404 subjects the received image data to speci- 
fied image processing steps in accordance with the or- 
der data to thereby produce a print or a recording me- 
dium having the image data recorded therein. On the 
other hand, the goods order center 406 delivers the or- 
dered goods to each customer in accordance with the 
goods order data. 

[0230] In addition, in each of the embodiments de- 
scribed above, an accident or a trouble can be prevent- 
ed by temporarily storing order information (goods order 
data) received from a customer at a laboratory or a 
goods order center and later transmitting information for 
confirming the order to each customer for order confir- 
mation. 
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[0231] Thus, it is preferable that the information for 
confirmation which includes goods order data and to 
which order transmitting route information indicating a 
route taken for placing an order is added for each order 
item is transmitted to a contact apparatus of each cus- s 
tomer in accordance with a customer ID. 
[0232] As described above in detail, according to 
each of the embodiments, a customer can easily place 
an order for printing of a scene on a TV or movie screen 
or an image actually taken with a camera, at an optional 
or desired timing or for recording image data of the 
scene on a recording medium while watching the TV or 
movie screen. The customer can also place an order for 
goods simply while watching an advertisement screen 
on a television or the like. 

[0233] In each of the embodiments described above, 
an order was placed for a print of an image displayed 
on a television or the like, a print of an image actually 
taken with a camera, a recording medium having its im- 
age data recorded therein, or goods on an advertise- 
ment screen of a television or the like. However, the 
present invention is not limited thereto and at least one 
of various types of data including moving image, voice, 
text and program may be ordered. 
[0234] For example, moving images within a specified 
period of time (for example a seconds) including the 
time at which a display screen of a television, a movie 
or a display was designated, to be more specific, moving 
images formed from a plurality of displayed images 
which include an Image displayed at the designated 
time, or Image data of all moving images in one com- 
mercial may be obtained. Alternatively, a program per 
se for reproducing an execution screen in a game ma- 
chine such as scenes of one stage may be obtained. 
[0235] In the present invention, the image displayed 
on the display screen of a digital television includes not 
only a picture (image) received through a tuner from an 
ordinary telecast but also a picture (image) distributed 
through a communication network such as the Internet. 
Further, the image display device for displaying the im- 
ages is not limited to the digital television but may also 
be a personal computer having in particular a picture 
display function. 

[0236] The image processing system and the order- 
ing system of the present Invention has been described 
above In detail. It is needless to mention that the present 
invention is not limited to the above-mentioned embod- 
iments but various improvements or alterations may be 
applied to it without departing from the spirit and the 
scope of the present invention. 
[0237] As described above, according to the first as- 
pect of the present invention, even if a plurality of subject 
persons exist, information concerning subject persons 
can be automatically composited with an image, which 
is convenient for obtaining the information concerning 
the subject persons or arranging information in order. In 
particular, the Image processing system is very effective 
in the infonnation exchange among participants In a par- 



ty. 

[0238] As also described above, according to the sec- 
ond aspect of the present invention, a customer can 
easily place an order for printing an image of a scene at 
an optional or desired timing, or again, at a preset timing 
while watching the screen of a television or the like, or 
an order for goods at a preset timing while watching an 
advertisement screen of the television or the like. 



1. An image processing system, Including: 

an image inputting unit for inputting an image 

of a subject; 

an image processing unit for applying image 
processing to the image inputted by said Image 
inputting unit; and 

an image outputting unit for outputting the im- 
age to which the image processing is applied 
by said image processing unit; further compris- 
ing: 

an accompanying information obtaining 
unit for obtaining accompanying infonna- 
tion concerning a subject person of said im- 
age; 

a subject information obtaining unit for ob- 
taining subject Information concerning said 
subject person from said inputted mage; 
a person identifying unit for identifying the 
subject person corresponding to said ac- 
companying information based on consist- 
ency between said accompanying Informa- 
tion and said subject information; and 
an image compositing unit for carrying out 
image composition associating said ac- 
companying information with a position of 
the subject person In a corresponding pho- 
tographed image based on a result of iden- 
tification by said person identifying unit. 

2. The image processing system according to claim 1 , 

wherein a camera for photographing said sub- 
ject obtains information recorded in a predeter- 
mined recording medium by communicating with a 
portable information apparatus held by the subject 
person or with an apparatus for collectively manag- 
ing accompanying infonnation for each subject per- 
son at the time of photographing, thereby obtaining 
said accompanying information, or said accompa- 
nying information is directly obtained from said ap- 
paratus for collectively managing accompanying in- 
formation. 

3. The image processing system according to claim 1 
or 2, 
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wherein all of said image processing unit, said 
image outputting unit, said accompanying informa- 
tion obtaining unit, said subject information obtain- 
ing unit, said person identifying unit and said image 
compositing unit are mounted with a camera, said 5 
image processing system is composed of said cam- 
era, and accompanying infomiation concerning the 
subject person in a photographed image is compos- 
ited with the photographed image in said camera. 

4. The image processing system according to claim 3, 

wherein said camera communicates with a 
portable information apparatus held by a subject 
person or with an apparatus for collectively manag- 
ing accompanying information for each subject per- 
son at the time of photographing, thereby obtaining 
accompanying infonnation concerning said subject 
person. 

5. The Image processing system according to any one 
of claims 1 to 4, 

wherein said camera further includes a voice 
obtaining unit, obtains voices of the subject person 
with said voice obtaining unit at the time of photo- 
graphing and uses the voices In carrying out said 
person identification. 

6. The image processing system according to any one 
of claims 1 to 5, 

wherein said accompanying information In- 
cludes a face Image of a subject person corre- 
sponding to said accompanying information and 
said person identifying unit carries out identification 
of the subject person using the face image. 

7. The Image processing system according to any one 
of claims 1 to 6, 

wherein said image outputting unit outputs an 
image in which said accompanying information is 
composited by at least one of a method of outputting 
the Image as a print, a method of recording the im- 
age in an image file, a method of displaying the im- 
age on an image displaying device and a method 
of transferring the image by communication. 

8. An ordering system comprising: 

a first information apparatus having an image 
displaying unit; and 

a second Information apparatus capable of 
transmitting order data at optional timing de- 
sired by a customer to said first information ap- 
paratus with respect to an image displayed on 
said image displaying unit of said first informa- 
tion apparatus, 

wherein said first Infonnation apparatus hav- 
ing received said order data adds predetermined 



data relating to said displayed image corresponding 
to said optional timing to said order data to prepare 
goods order data and transmits the goods order da- 
ta to a third information apparatus in a predeter- 
mined destination of transmission. 

9. The ordering system according to claim 8, 

wherein said order data is orderer identifica- 
tion information or order indication information for 
specifically indicating said orderer identification in- 
formation and contents of an order, 

information on said optional timing to be ob- 
tained by said first information apparatus is time in- 
formation in said second information apparatus ac- 
companying said order data or receiving timing It- 
self of said order data in said first infonmation appa- 
ratus, and 

said predetermined data is image data of said 
displayed image corresponding to said optional tim- 
ing or goods characteristic information relating said 
displayed Image. 

10. The ordering system according to any one of claim 
8 or 9, 

wherein said predetemnined destination of 
transmission of said goods order data Is set in said 
second Information apparatus or set in said first in- 
formation apparatus or set according to said prede- 
termined data. 

1 1 . The ordering system according to any one of claims 
8 to 10. 

wherein said order data is transmitted from 
said second information apparatus to said first in- 
fonnation apparatus by the customer at said de- 
sired optional timing while watching said displayed 
Image. 

12. The ordering system according to any one of claims 
8 to 11, 

wherein said order data is transmitted in ad- 
vance from said second infonnation apparatus to 
said first information apparatus by the customer as 
reservation information relating to said displayed 
image of said first information apparatus, 

said first Information apparatus regards a 
point in time when said displayed image reserved 
by the reservation information is displayed on said 
image displaying unit as said desired optional tim- 
ing, automatically obtains predetemnined data relat- 
ing to said displayed Image of said Image displaying 
unit at said optional timing and automatically trans- 
mits the predetermined data to said second infor- 
mation apparatus, and 

said second Information apparatus automati- 
cally obtains said predetermined data. 

1 3. The ordering system according to any one of claims 
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8 to 12. 

wherein said order data includes print order 
data for ordering a print of an image displayed on 
said image displaying unit of said first information 
apparatus at said optional timing, 

said predetermined data Includes image data 
of an image displayed on said image displaying unit 
of said first information apparatus at said optional 
timing, compressed image data or processed image 
data thereof and information related thereto, 

said goods order data includes print order da- 
ta for ordering a print of an image displayed on said 
image displaying unit of said first information appa- 
ratus, and 

said first Information apparatus transmits said 
print order data to said predetermined destination 
of transmission and said predetermined destination 
of transmission applies print processing to said print 
order data or records and accumulates said print 
order data in a predetermined image data accumu- 
lating device. 

14. The ordering system according to claim 13, 

wherein said print order data includes print in- 
struction infonmation or data recording instruction 
information. 

15. The ordering system according to any one of claims 
8 to 14. 

wherein said order data includes recording 
medium order data for ordering a recording medium 
in which data corresponding to an image displayed 
on said image displaying unit of said first informa- 
tion apparatus at said optional timing is recorded, 

said predetermined data Includes data conre- 
sponding to said displayed image at said optional 
timing and infonnation related thereto, 

said goods order data includes recording me- 
dium order data for ordering a recording medium in 
which data corresponding to said displayed image 
is recorded, and 

said first Information apparatus transmits said 
recording medium order data to said predetermined 
destination of transmission and said predetermined 
destination of transmission applies processing for 
recording said recording medium order data in said 
recording medium or records and accumulates said 
recording medium order data in a predetermined 
image data accumulating device. 

16. The ordering system according to claim 15, 

wherein said data corresponding to said dis- 
played image includes image data of said displayed 
image at said optional timing and compressed im- 
age data or processed image data thereof. 

17. The ordering system according to claim 15 or 16, 

wherein said data corresponding to said dis- 



played image is at least one of moving image data, 
voice data, text data and program data relating to 
said displayed image at said optional timing. 

5 18. The ordering system according to any one of claims 
15 to 17. 

wherein said recording medium order data in- 
cludes information on instruction for recording in 
said recording medium or Information on instruction 
10 for recording In said predetermined Image data ac- 
cumulating device. 

1 9. The ordering system according to any one of claims 
13 to 18, 

15 wherein said related infonnation includes at 

least one of still image data, moving image data, 
voice data, text data and program data and is print- 
ed in association with said Image data and said data 
corresponding to said displayed image and output- 

20 ted to a computer readable recording medium in as- 
sociation with said image data or said data corre- 
sponding to said displayed image. 

20. The ordering system according to any one of claims 
25 13 to 19. 

wherein said related information includes edi- 
tion information and/or processing information of 
said image data or said data corresponding to said 
displayed image. 

30 

21 . The ordering system according to any one of claims 
8 to 20, 

wherein, when said first information appara- 
tus is a television receiver and predetermined data 

35 relating to said displayed Image at said optional tim- 
ing includes image data of said displayed image of 
said television receiver, image data of an image re- 
ceived by said television receiver and displayed 
thereon and original image data in a broadcasting 

40 station transmitting the Image data to said television 
receiver are properly used as said image data of 
said displayed image of said television receiver. 

22. An ordering system comprising: 

45 

a first information apparatus having an image 
displaying unit; and 

a second information apparatus capable of 
transmitting order data at optional timing de- 
50 sired by a customer to said first infonmation ap- 

paratus with respect to an image displayed on 
said image displaying unit of said first informa- 
tion apparatus. 

55 wherein said second information apparatus 

transmits data requiring infonmation to said first in- 
formation apparatus as said order data at said op- 
tional timing, 
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said first information apparatus having re- 
ceived said data requiring information returns pre- 
determined data relating to said displayed image at 
said optional timing to said second infonnation ap- 
paratus and/or a fourth information apparatus in a 
destination of communication designated by the 
customer, and 

said second information apparatus and/or 
said fourth information apparatus reproduces and 
edits said predetermined data relating to said re- 
ceived displayed image to prepare goods order da- 
ta and transmits the goods order data to a third in- 
formation apparatus in a predetermined destination 
of transmission via said first information apparatus 
or directly. 

23. The ordering system according to claim 22, 

wherein said predetermined data relating to 
said displayed image is at feast one of image data 
of said displayed image and information related 
thereto. 

24. The ordering system according to claim 23, 

wherein said related information is goods re- 
lated infomiation or information for inputting an or- 
der, and 

said goods order data is edited data of said 
information for inputting an order and orderer iden- 
tification information. 

25. The ordering system according to any one of claims 
22 to 24. 

wherein said data requiring information in- 
cludes information on said fourth information appa- 
ratus in the destination of communication designat- 
ed by the customer. 

26. The ordering system according to any one of claims 
22 to 25, 

wherein said data requiring information in- 
cludes order data for designating said desired op- 
tional timing and information on said fourth infonma- 
tion apparatus in at least one destination of commu- 
nication designated by the customer and said first 
information apparatus distributes said predeter- 
mined data relating to said displayed image to said 
fourth information apparatus in said at least one 
destination of communication via a communication 
network. 

27. The ordering system according to any one of claims 
22 to 26. 

wherein said predetermined destination of 
transmission of said goods order data is set in said 
second information apparatus or set in said first in- 
formation apparatus or set according to said prede- 
termined data. 



28. The ordering system according to any one of claims 
22 to 27, 

wherein said order data is transmitted from 
said second information apparatus to said first in- 
5 formation apparatus by the customer at said de- 
sired optional timing while watching said displayed 
image. 

29. The ordering system according to any one of claims 
10 22 to 27, 

wherein said order data Is transmitted In ad- 
vance from said second information apparatus to 
said first information apparatus by the customer as 
reservation information relating to said displayed 
15 image of said first information apparatus, 

said first infomiation apparatus regards a 
point in time when said displayed image reserved 
by the reservation information is displayed on said 
image displaying means as said desired optional 
20 timing, automatically obtains predetermined data 
relating to said displayed image of said image dis- 
playing means at said optional timing and automat- 
ically transmits the predetermined data to said sec- 
ond information apparatus, and 
25 said second information apparatus automati- 

cally obtains said predetermined data. 

30. The ordering system according to any one of claims 
22 to 29, 

30 wherein said order data is an image data re- 

quiring signal for requiring transfer of an image dis- 
played on said image displaying means of said first 
information apparatus to said second information 
apparatus, 

35 said first information apparatus having re- 

ceived said image data requiring signal returns im- 
age data of said displayed image at said optional 
timing and compressed image data or processed 
image data thereof to said second information ap- 
40 paratus together with said related information, and 
said second information apparatus transmits 
said image data, said compressed image data or 
processed image data thereof and information re- 
lated thereto to said predetermined destination of 
45 transmission as print order data via said first infor- 
mation apparatus or directly and said predeter- 
mined destination of transmission applies print 
processing to said print order data or records and 
accumulates said print order data in a predeter- 
50 mined image data accumulating device. 

31. The ordering system according to claim 30, 

wherein said print order data includes print in- 
struction information or data recording instruction 
55 information. 

32. The ordering system according to any one of claims 
22 to 31. 
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wherein said order data is an image data re- 
quiring signal for requiring transfer of an image dis- 
played on said image displaying means of said first 
information apparatus to said second information 
apparatus, 

said first information apparatus having re- 
ceived said image data requiring signal returns data 
corresponding to said displayed image at said op- 
tional timing to said second information apparatus 
together with said related information, and 

said second information apparatus transmits 
said data corresponding to said displayed image 
and said related information to said predetermined 
destination of transmission as recording medium 
order data via said first information apparatus or di- 
rectly and said predetermined destination of trans- 
mission applies processing for recording said re- 
cording medium order data in said recording medi- 
um or records and accumulates said recording me- 
dium order data in a predetemnined image data ac- 
cumulating device. 

33. The ordering system according to claim 32, 

wherein said data corresponding to said dis- 
played image includes image data of said displayed 
image at said optional timing and compressed im- 
age data or processed image data thereof. 

34. The ordering system according to claim 32 or 33, 

wherein said data corresponding to said dis- 
played image is at least one of moving image data, 
voice data, text data and program data relating to 
said displayed image at said optional timing. 

35. The ordering system according to any one of claims 
32 to 34. 

wherein said recording medium order data in- 
cludes information on instruction for recording in 
said recording medium or information on instruction 
for recording in said predetermined image data ac- 
cumulating device. 

36. The ordering system according to any one of claims 
30 to 35, 

wherein said related infomnation includes at 
least one of still Image data, moving Image data, 
voice data, text data and program data and is print- 
ed in association with said image data and said data 
corresponding to said displayed image and output- 
ted to a computer readable recording medium in as- 
sociation with said image data or said data corre- 
sponding to said displayed image. 

37. The ordering system according to any one of claims 
30 to 36, 

wherein said related information includes edi- 
tion information and/or processing information of 
said image data or said data corresponding to said 



displayed image. 

38. The ordering system according to any one of claims 
22 to 37, 

5 wherein, when said first information appara- 

tus is a television receiver and predetermined data 
relating to said displayed image at said optional tim- 
ing includes image data of said displayed image of 
said television receiver, image data of an image re- 

10 ceived by said television receiver and displayed 
thereon and original image data in a broadcasting 
station transmitting the image data to said television 
receiver are properly used as said image data of 
said displayed image of said television receiver. 

15 

39. The ordering system according to any one of claims 
8 to 21, 

wherein said goods order data of the custom- 
er is temporarily accumulated, and 
20 information for confirmation with order trans- 

mitting route information added to said goods order 
data is transmitted to said destination of communi- 
cation of the customer for each order item based on 
orderer identification information. 

25 

40. The ordering system according to any one of claims 
22 to 38, 

wherein said goods order data of the custom- 
er is temporarily accumulated, and 
30 information for confirmation with order trans- 

mitting route information added to said goods order 
data is transmitted to said destination of communi- 
cation of the customer for each order item based on 
orderer identification information. 

35 

41 . An ordering system comprising: 

a first information apparatus having an image 
photographing function; and 
40 a second information apparatus for transmitting 

subject related information in image photo- 
graphing to said first information apparatus, 

wherein said first information apparatus trans- 
45 mits subject related Information transmitted from 
said second information apparatus and photo- 
graphed image data to a predetermined destination 
of transmission as print order data, and said prede- 
termined destination of transmission composites 
50 said subject related Information with said photo- 
graphed image or prints said subject related infor- 
mation on the rear side of said photographed image 
to prepare a print or associates said subject related 
information with said photographed image to output 
55 them to a computer readable recording medium as 
image data, character data or voice data. 

42. The ordering system according to claim 41, 
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wherein said goods order data of the custom- 
er is temporarily accumulated, and 

information for confirmation with order trans- 
mitting route information added to said goods order 
data is transmitted to said destination of communi- 5 
cation of the customer for each order item based on 
orderer identification information. 

43. An ordering system comprising: 

10 

a first information apparatus having an Image 
photographing function, and 
a second information apparatus for receiving 
photographed image data and order data trans- 
mitted from said first information apparatus, 

wherein said second information apparatus 
adds subject related information to photographed 
image data and order data transmitted from said 
first information apparatus to transmit them to a pre- 20 
determined destination of transmission, and said 
predetermined destination of transmission compos- 
ites said subject related information with said pho- 
tographed image or prints said subject related infor- 
mation on the rear side of said photographed image 25 
to prepare a print or associates said subject related 
information with said photographed image to output 
them to a computer readable recording medium as 
image data, character data or voice data. 

30 

44. The ordering system according to claim 43, 

wherein said goods order data of the custom- 
er is temporarily accumulated, and 

information for confirmation with order trans- 
mitting route information added to said goods order 35 
data is transmitted to said destination of communi- 
cation of the customer for each order item based on 
orderer identification infomiation. 
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